00000001:02000400:3.0F:1788841713.672381:0:2983:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1788841722.181112:0:3185:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1788841723.170465:0:3244:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1263 MB/s 00000001:01000000:3.0:1788841723.420253:0:3244:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1255 MB/s 00000001:01000000:0.0F:1788841723.669990:0:3244:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5587 MB/s 00000020:02000000:1.0F:1788841724.414751:0:3276:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_114_gc92b566 00000400:02000000:1.0:1788841725.617201:0:3291:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.155@tcp [8/256/0/180] 00008000:02000000:0.0:1788841729.529324:0:3441:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788841781.748271:0:5248:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788841793.376892:0:5831:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788841793.376899:0:5831:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788841793.377039:0:5831:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000e680ca98 00000080:02000400:3.0:1788841793.377052:0:5831:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788841793.382140:0:5831:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788841793.382156:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788841793.382287:0:5831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000005c14528c) 00000020:00000080:0.0:1788841793.382310:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788841793.397207:0:5831:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788841793.397825:0:5831:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788841793.417529:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788841793.417571:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788841793.417592:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788841793.417643:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788841793.417670:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788841793.418047:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788841793.418056:0:5831:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788841793.418079:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3de1064d33a8adae 00000020:01000004:1.0:1788841793.418087:0:5831:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788841793.418092:0:5831:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788841793.418097:0:5831:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e680ca98 from MGS 00000020:01000004:1.0:1788841793.418101:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788841793.418124:0:5831:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000e1513d41) 00000020:00000080:1.0:1788841793.418141:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788841793.418241:0:5831:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e680ca98 from MGS, refs=2 00080000:01000000:1.0:1788841793.418247:0:5831:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788841793.418252:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3de1064d33a8adbc 00000100:00100000:1.0:1788841793.418480:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788841793.418635:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788841793.418642:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788841793.419206:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788841793.419213:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788841793.420172:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788841793.420504:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788841793.420511:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788841793.421136:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788841793.421143:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788841793.421553:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788841793.421559:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788841793.422233:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841793.422236:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841793.422238:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841793.423011:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841793.423015:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841793.423016:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841793.423821:0:5831:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788841793.432516:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788841793.674868:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2071 MB/s 00000001:01000000:2.0:1788841793.925154:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2243 MB/s 00000001:01000000:0.0:1788841794.176586:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 561 MB/s 00000001:01000000:3.0:1788841794.426407:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 443 MB/s 00010000:00010000:2.0:1788841794.434266:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788841794.440701:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1788841794.458759:0:5831:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788841794.458777:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788841794.458780:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788841794.459848:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788841794.460031:0:5831:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788841794.460130:0:5831:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788841794.460449:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788841794.460484:0:5831:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788841794.460849:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788841794.461559:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788841794.461567:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788841794.471990:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788841794.472017:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788841794.476616:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788841794.476631:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788841794.481206:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788841794.481234:0:5831:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.155@tcp' 00000020:01000004:0.0:1788841794.481236:0:5831:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788841794.481298:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.155@tcp (typ=mgc) 00000020:00000080:0.0:1788841794.481311:0:5831:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.155@tcp (00000000545872bd) 00000020:00000080:0.0:1788841794.481341:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788841794.481437:0:5831:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002397e439@MGC192.168.204.155@tcp: add connection 192.168.204.155@tcp at head 00010000:00010000:0.0:1788841794.481599:0:5831:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.155@tcp-0 is initialized 00000040:01000000:0.0:1788841794.481606:0:5831:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.155@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788841794.482255:0:5846:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788841794.482516:0:5847:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788841794.482553:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.155@tcp (uuid fd738bcb-4fee-4a21-af92-bab36d5458e2) 00000020:00000080:1.0:1788841794.482572:0:5831:0:(genops.c:1385:class_connect()) connect: client fd738bcb-4fee-4a21-af92-bab36d5458e2, cookie 0x3de1064d33a8adca 00000100:00080000:1.0:1788841794.482582:0:5831:0:(import.c:510:import_select_connection()) MGC192.168.204.155@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788841794.482587:0:5831:0:(import.c:624:import_select_connection()) MGC192.168.204.155@tcp: import 000000002397e439 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:1.0:1788841794.482630:0:5831:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f0fc48d5 x1875736500633728/t0(0) o250->MGC192.168.204.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788841794.482658:0:5831:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import fd738bcb-4fee-4a21-af92-bab36d5458e2->MGS 00000020:01000004:1.0:1788841794.482676:0:5831:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788841794.482680:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788841794.482690:0:5831:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000057fe2523) 00000020:00000080:1.0:1788841794.482702:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788841794.486020:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f0fc48d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fd738bcb-4fee-4a21-af92-bab36d5458e2:3306:1875736500633728:0@lo:250: 00000100:00100000:3.0:1788841794.486140:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841794.486223:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500633728 00000100:00100000:3.0:1788841794.486232:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500633728 00000100:00100000:3.0:1788841794.486284:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788841794.486290:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db911e82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3306:x1875736500633728:12345-0@lo:250: 00010000:00080000:3.0:1788841794.486318:0:5842:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from fd738bcb-4fee-4a21-af92-bab36d5458e2@0@lo t0 exp 0000000000000000 cur 122 last 0 00000020:00000080:3.0:1788841794.486347:0:5842:0:(genops.c:1385:class_connect()) connect: client fd738bcb-4fee-4a21-af92-bab36d5458e2, cookie 0x3de1064d33a8add8 00000100:00080000:3.0:1788841794.486512:0:5842:0:(import.c:65:import_set_state_nolock()) 000000009de57601 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788841794.486564:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db911e82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+5:3306:x1875736500633728:12345-0@lo:250: Request processed in 274us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841794.486572:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788841794.486608:0:3306:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.155@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788841794.486622:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.155@tcp: connect to target with instance 0 00000100:00080000:3.0:1788841794.486630:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.155@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788841794.486634:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788841794.486637:0:3306:0:(import.c:65:import_set_state_nolock()) 000000002397e439 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788841794.486639:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788841794.486642:0:3306:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788841794.486647:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f0fc48d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fd738bcb-4fee-4a21-af92-bab36d5458e2:3306:1875736500633728:0@lo:250: 00000100:00100000:1.0:1788841794.497512:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788841794.497845:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788841794.497852:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788841794.498375:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788841794.498380:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788841794.498566:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788841794.498572:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788841794.501536:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788841794.501797:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788841794.501810:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788841794.508411:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788841794.508424:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788841794.578679:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788841794.578992:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788841794.578998:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788841794.582209:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788841794.582227:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788841794.588649:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788841794.589424:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788841794.589433:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788841794.590415:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788841794.590425:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788841794.591194:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788841794.592103:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788841794.592111:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788841794.593219:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788841794.593231:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788841794.594218:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788841794.594458:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788841794.594464:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788841794.599419:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788841794.599433:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788841794.648393:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788841794.648660:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788841794.648668:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788841794.653810:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788841794.653828:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788841794.660623:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788841794.660643:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788841794.662655:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788841794.662686:0:5831:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788841794.662694:0:5831:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.155@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788841794.663058:0:5831:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.155@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788841794.663430:0:5831:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.155@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788841794.663436:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788841794.663438:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788841794.663439:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788841794.663440:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788841794.663441:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788841794.663442:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788841794.663443:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788841794.663445:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788841794.663446:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788841794.663447:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788841794.663449:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788841794.663450:0:5831:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788841794.663453:0:5831:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788841794.663455:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788841794.663457:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788841794.663458:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788841794.663459:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788841794.663459:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788841794.663460:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788841794.663461:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788841794.663462:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788841794.663463:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788841794.663468:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788841794.663469:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788841794.663470:0:5831:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788841794.663511:0:5831:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788841794.663533:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1fbb123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500633856:0@lo:253: 00000100:00100000:2.0:1788841794.663634:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841794.663766:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000df5684cb going to sleep for 11 seconds 00000100:00100000:1.0:1788841794.665185:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500633856 00000100:00100000:1.0:1788841794.665202:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500633856 00000100:00100000:1.0:1788841794.665257:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788841794.665266:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe0d3bee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+5:5831:x1875736500633856:12345-0@lo:253: 20000000:01000000:1.0:1788841794.665379:0:5845:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788841794.665382:0:5845:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788841794.667478:0:5866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788841794.667583:0:5845:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788841794.667956:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788841794.669183:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788841794.672586:0:5845:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788841794.672595:0:5845:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788841794.672601:0:5845:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788841794.672604:0:5845:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788841794.672632:0:5845:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788841794.672923:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788841794.673388:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788841794.673404:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788841794.673459:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788841794.673509:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788841794.673561:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788841794.673656:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788841794.673665:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788841794.674065:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788841794.674077:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788841794.674167:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788841794.674175:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788841794.674206:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788841794.674256:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788841794.674696:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788841794.674704:0:5845:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788841794.675296:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788841794.675547:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788841794.675564:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788841794.675605:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788841794.675640:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788841794.675699:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788841794.676395:0:5845:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788841794.676515:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788841794.676526:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788841794.676580:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788841794.676617:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788841794.676651:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788841794.676661:0:5845:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788841794.676775:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788841794.676785:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788841794.676818:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788841794.676887:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788841794.677102:0:5845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788841794.677154:0:5845:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788841794.677162:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788841794.678573:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788841794.678950:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788841794.678978:0:5845:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.155@tcp for mdt 20000000:01000000:1.0:1788841794.678980:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.155@tcp (null) (null) (null) 00000040:00080000:1.0:1788841794.679017:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788841794.679024:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788841794.681061:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788841794.681098:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.155@tcp (null) (null) 00000040:00080000:1.0:1788841794.681217:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788841794.681231:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788841794.681264:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788841794.681299:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788841794.681414:0:5845:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788841794.681417:0:5845:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788841794.681421:0:5845:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788841794.681455:0:5845:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788841794.681458:0:5845:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788841794.681490:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788841794.681492:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788841794.683219:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1788841794.687134:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788841794.687191:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1788841794.687270:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1788841794.687290:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788841794.687293:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788841794.690415:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788841794.693704:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788841794.693790:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788841794.693834:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1788841794.693878:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788841794.693881:0:5845:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1788841794.693887:0:5845:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788841794.693889:0:5845:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788841794.693894:0:5845:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788841794.693901:0:5845:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788841794.694478:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1788841794.694633:0:5845:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788841794.705146:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1788841794.705203:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1788841794.705286:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1788841794.705309:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788841794.705332:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d515cdc8/0x3de1064d33a8addf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841794.705350:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d515cdc8/0x3de1064d33a8addf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841794.705359:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d515cdc8/0x3de1064d33a8addf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841794.705365:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d515cdc8/0x3de1064d33a8addf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841794.705370:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d515cdc8/0x3de1064d33a8addf lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841794.705377:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d515cdc8/0x3de1064d33a8addf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841794.705382:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d515cdc8 already unused, calling callback (00000000645e44bd) 00010000:00010000:1.0:1788841794.705386:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d515cdc8/0x3de1064d33a8addf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841794.705393:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d515cdc8/0x3de1064d33a8addf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841794.705407:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d515cdc8/0x3de1064d33a8addf lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841794.705437:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d515cdc8/0x3de1064d33a8addf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841794.705443:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d515cdc8/0x3de1064d33a8addf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788841794.705464:0:5845:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788841794.928755:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe0d3bee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+5:5831:x1875736500633856:12345-0@lo:253: Request processed in 263480us (265111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841794.928773:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788841794.928892:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1fbb123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500633856:0@lo:253: 10000000:01000000:2.0:1788841794.928909:0:5831:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788841794.928912:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788841794.928914:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788841794.928916:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788841794.928917:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788841794.928918:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788841794.928920:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788841794.928921:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788841794.928922:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788841794.928923:0:5831:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788841794.928925:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788841794.928926:0:5831:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788841794.928947:0:5831:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e680ca98 from lustre-MDT0000 10000000:01000000:2.0:1788841794.928991:0:5831:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788841794.928995:0:5831:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788841794.929000:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d3a435699b8 10000000:01000000:2.0:1788841794.929005:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788841794.929012:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d3a435699b8 from 1 10000000:01000000:2.0:1788841794.929015:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788841794.929063:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: 000000002d1397de/0x3de1064d33a8ade6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841794.929074:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: 000000002d1397de/0x3de1064d33a8ade6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841794.929082:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: 000000002d1397de/0x3de1064d33a8ade6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841794.929100:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1fbb123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500633984:0@lo:101: 00000100:00100000:2.0:1788841794.929158:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841794.929255:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000297e2d1a going to sleep for 11 seconds 00000100:00100000:0.0:1788841794.929571:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500633984 00000100:00100000:0.0:1788841794.929578:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500633984 00000100:00100000:0.0:1788841794.929875:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788841794.929885:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd6cd943 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+5:5831:x1875736500633984:12345-0@lo:101: 00010000:00010000:0.0:1788841794.929900:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841794.929917:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002e5cb22b/0x3de1064d33a8aded lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8ade6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841794.929942:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002e5cb22b/0x3de1064d33a8aded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8ade6 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841794.929951:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002e5cb22b/0x3de1064d33a8aded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8ade6 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841794.929968:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002e5cb22b, rc 0) 00000100:00100000:0.0:1788841794.930032:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd6cd943 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+6:5831:x1875736500633984:12345-0@lo:101: Request processed in 149us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841794.930048:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788841794.930121:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1fbb123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500633984:0@lo:101: 00010000:00010000:2.0:1788841794.930142:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: 000000002d1397de/0x3de1064d33a8ade6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8aded expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841794.930150:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: 000000002d1397de/0x3de1064d33a8ade6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8aded expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841794.930198:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1fbb123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500634112:0@lo:501: 00000100:00100000:2.0:1788841794.930226:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841794.930353:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000297e2d1a going to sleep for 11 seconds 00000100:00100000:3.0:1788841794.930497:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500634112 00000100:00100000:3.0:1788841794.930503:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500634112 00000100:00100000:3.0:1788841794.930532:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788841794.930538:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000453cb8b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+6:5831:x1875736500634112:12345-0@lo:501: 00000100:00100000:3.0:1788841794.930809:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000453cb8b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+6:5831:x1875736500634112:12345-0@lo:501: Request processed in 271us (582us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788841794.930816:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788841794.930897:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1fbb123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500634112:0@lo:501: 10000000:01000000:2.0:1788841794.930921:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788841794.930940:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: 000000002d1397de/0x3de1064d33a8ade6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8aded expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841794.930948:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: 000000002d1397de/0x3de1064d33a8ade6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8aded expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841794.930957:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d3a43e8f800 10000000:01000000:2.0:1788841794.930961:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788841794.930966:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d3a43e8f800 10000000:01000000:2.0:1788841794.930968:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788841794.930971:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d3a43e8f800 from 1 10000000:01000000:2.0:1788841794.930974:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788841794.930993:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: 0000000076f57686/0x3de1064d33a8adf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841794.931000:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: 0000000076f57686/0x3de1064d33a8adf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841794.931020:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: 0000000076f57686/0x3de1064d33a8adf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841794.931045:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1fbb123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500634240:0@lo:101: 00000100:00100000:2.0:1788841794.931076:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841794.931103:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000297e2d1a going to sleep for 11 seconds 00000100:00100000:2.0:1788841794.931122:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500634240 00000100:00100000:2.0:1788841794.931126:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500634240 00000100:00100000:2.0:1788841794.931156:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788841794.931161:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf112f64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+6:5831:x1875736500634240:12345-0@lo:101: 00010000:00010000:2.0:1788841794.931169:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841794.931179:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bb0dde7d/0x3de1064d33a8adfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8adf4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841794.931194:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bb0dde7d/0x3de1064d33a8adfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8adf4 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841794.931202:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bb0dde7d/0x3de1064d33a8adfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8adf4 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841794.931209:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bb0dde7d, rc 0) 00000100:00100000:2.0:1788841794.931237:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf112f64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+7:5831:x1875736500634240:12345-0@lo:101: Request processed in 75us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841794.931242:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788841794.931270:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1fbb123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500634240:0@lo:101: 00010000:00010000:2.0:1788841794.931281:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: 0000000076f57686/0x3de1064d33a8adf4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8adfb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841794.931298:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: 0000000076f57686/0x3de1064d33a8adf4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8adfb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841794.931427:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788841794.931439:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: 0000000076f57686/0x3de1064d33a8adf4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8adfb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841794.931446:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: 0000000076f57686/0x3de1064d33a8adf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8adfb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841794.931452:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788841794.931455:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788841794.931459:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d3a43e8f800 10000000:01000000:2.0:1788841794.931461:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788841794.931464:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788841794.931466:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788841794.931478:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: 000000009d5917e9/0x3de1064d33a8ae02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841794.931483:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: 000000009d5917e9/0x3de1064d33a8ae02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841794.931488:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: 000000009d5917e9/0x3de1064d33a8ae02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841794.931499:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1fbb123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500634368:0@lo:101: 00000100:00100000:2.0:1788841794.931523:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841794.931537:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000297e2d1a going to sleep for 11 seconds 00000100:00100000:2.0:1788841794.931556:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500634368 00000100:00100000:2.0:1788841794.931559:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500634368 00000100:00100000:2.0:1788841794.931576:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788841794.931581:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e089d0ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+7:5831:x1875736500634368:12345-0@lo:101: 00010000:00010000:2.0:1788841794.931588:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841794.931596:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002eb7e48f/0x3de1064d33a8ae09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8ae02 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841794.931608:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002eb7e48f/0x3de1064d33a8ae09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8ae02 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841794.931615:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002eb7e48f/0x3de1064d33a8ae09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8ae02 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841794.931620:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002eb7e48f, rc 0) 00000100:00100000:2.0:1788841794.931648:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e089d0ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+8:5831:x1875736500634368:12345-0@lo:101: Request processed in 67us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841794.931654:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788841794.931683:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1fbb123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500634368:0@lo:101: 00010000:00010000:2.0:1788841794.931692:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: 000000009d5917e9/0x3de1064d33a8ae02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8ae09 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841794.931698:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: 000000009d5917e9/0x3de1064d33a8ae02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8ae09 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841794.931756:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1fbb123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500634496:0@lo:501: 00000100:00100000:2.0:1788841794.931779:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841794.931791:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000297e2d1a going to sleep for 11 seconds 00000100:00100000:2.0:1788841794.931804:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500634496 00000100:00100000:2.0:1788841794.931812:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500634496 00000100:00100000:2.0:1788841794.931830:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788841794.931835:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c6c83c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+8:5831:x1875736500634496:12345-0@lo:501: 00000100:00100000:2.0:1788841794.932018:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c6c83c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+9:5831:x1875736500634496:12345-0@lo:501: Request processed in 182us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841794.932025:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788841794.932071:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1fbb123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500634496:0@lo:501: 00000100:00100000:2.0:1788841794.932096:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1fbb123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500634624:0@lo:503: 00000100:00100000:2.0:1788841794.932134:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841794.932147:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000297e2d1a going to sleep for 11 seconds 00000100:00100000:2.0:1788841794.932161:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500634624 00000100:00100000:2.0:1788841794.932164:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500634624 00000100:00100000:2.0:1788841794.932181:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788841794.932186:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7e2754f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+9:5831:x1875736500634624:12345-0@lo:503: 00000100:00100000:2.0:1788841794.932550:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7e2754f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+9:5831:x1875736500634624:12345-0@lo:503: Request processed in 362us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841794.932556:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788841794.932682:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1fbb123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500634624:0@lo:503: 00000100:00100000:3.0:1788841794.933223:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000547cc0fc pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:5874:1875736500634752:0@lo:502: 00000100:00100000:3.0:1788841794.933269:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841794.933419:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set 00000000836f9a55 going to sleep for 11 seconds 00000100:00100000:2.0:1788841794.933455:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500634752 00000100:00100000:2.0:1788841794.933460:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500634752 00000100:00100000:2.0:1788841794.933533:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788841794.933540:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b35c3e99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+9:5874:x1875736500634752:12345-0@lo:502: 00000100:00100000:2.0:1788841794.933760:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b35c3e99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+9:5874:x1875736500634752:12345-0@lo:502: Request processed in 221us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841794.933767:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788841794.933880:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000547cc0fc pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:5874:1875736500634752:0@lo:502: 00000020:01000000:3.0:1788841794.933907:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788841794.933917:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841794.933919:0:5874:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788841794.933925:0:5874:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788841794.933928:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788841794.933949:0:5874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000171fbf92) 00000020:00000080:3.0:1788841794.933967:0:5874:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788841794.933974:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788841794.934056:0:5874:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788841794.934063:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3de1064d33a8ae17 00000020:00000080:3.0:1788841794.934274:0:5874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788841794.934278:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788841794.934282:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841794.934283:0:5874:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788841794.934286:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788841794.934289:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841794.934290:0:5874:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788841794.934293:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788841794.934298:0:5874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000f64a2164) 00000020:00000080:3.0:1788841794.934324:0:5874:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788841794.934329:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788841794.934330:0:5874:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788841794.934333:0:5874:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788841794.934338:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788841794.934381:0:5874:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e680ca98 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788841794.934393:0:5874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000814e2b42) 00000020:00000080:3.0:1788841794.934401:0:5874:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788841794.934462:0:5874:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788841794.934468:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3de1064d33a8ae2c 00000020:00000080:3.0:1788841794.934599:0:5874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788841794.934605:0:5874:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788841794.934610:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3de1064d33a8ae33 00080000:01000000:3.0:1788841794.934614:0:5874:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788841794.934617:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3de1064d33a8ae3a 00080000:10000000:3.0:1788841794.935014:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788841794.935265:0:5874:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788841794.939423:0:5874:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788841795.003294:0:5874:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788841795.004763:0:5874:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788841795.010989:0:5874:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788841795.011559:0:5874:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788841795.042886:0:5874:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000ba2cc048) 00000020:00000080:0.0:1788841795.042914:0:5874:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788841795.042992:0:5874:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788841795.043000:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3de1064d33a8ae48 00000020:00000080:0.0:1788841795.043692:0:5874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1788841795.046521:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788841795.095774:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788841795.117221:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788841795.144589:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788841795.178486:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788841795.213578:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1788841795.251817:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3de1064d33a8ae4f 00000020:00000080:1.0:1788841795.252190:0:5874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788841795.252203:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788841795.252210:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841795.252211:0:5874:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788841795.252214:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788841795.252218:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841795.252219:0:5874:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788841795.252222:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788841795.252223:0:5874:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788841795.252227:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788841795.252229:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841795.252230:0:5874:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788841795.252232:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788841795.252236:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841795.252236:0:5874:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788841795.252240:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788841795.252281:0:5874:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1788841795.252412:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b0f0524b pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:5874:1875736500634880:0@lo:502: 00000100:00100000:1.0:1788841795.252497:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841795.252547:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dcb4ae8d going to sleep for 11 seconds 00000100:00100000:1.0:1788841795.252576:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500634880 00000100:00100000:1.0:1788841795.252583:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500634880 00000100:00100000:1.0:1788841795.252627:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788841795.252637:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d54a8c59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+9:5874:x1875736500634880:12345-0@lo:502: 00000100:00100000:1.0:1788841795.253109:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d54a8c59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+9:5874:x1875736500634880:12345-0@lo:502: Request processed in 474us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841795.253118:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788841795.253171:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b0f0524b pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:5874:1875736500634880:0@lo:502: 00000020:01000000:1.0:1788841795.253196:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788841795.253202:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841795.253204:0:5874:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1788841795.253207:0:5874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788841795.253441:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788841795.253459:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788841795.253474:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: 000000009d5917e9/0x3de1064d33a8ae02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8ae09 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841795.253484:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: 000000009d5917e9/0x3de1064d33a8ae02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8ae09 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841795.253491:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d3a43e8f800 from 1 10000000:01000000:0.0:1788841795.253494:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788841795.253533:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: 00000000018667da/0x3de1064d33a8ae56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841795.253541:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: 00000000018667da/0x3de1064d33a8ae56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841795.253560:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: 00000000018667da/0x3de1064d33a8ae56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841795.253574:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000031d1cda3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500635008:0@lo:101: 00000100:00100000:0.0:1788841795.253605:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841795.253622:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a786a8d3 going to sleep for 11 seconds 00000100:00100000:0.0:1788841795.253647:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500635008 00000100:00100000:0.0:1788841795.253652:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500635008 00000100:00100000:0.0:1788841795.253676:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788841795.253682:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a3fd07a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+9:5831:x1875736500635008:12345-0@lo:101: 00010000:00010000:0.0:1788841795.253691:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841795.253701:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fc991e91/0x3de1064d33a8ae5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8ae56 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841795.253744:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fc991e91/0x3de1064d33a8ae5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8ae56 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841795.253753:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fc991e91/0x3de1064d33a8ae5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8ae56 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841795.253762:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fc991e91, rc 0) 00000100:00100000:0.0:1788841795.253790:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a3fd07a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+10:5831:x1875736500635008:12345-0@lo:101: Request processed in 108us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841795.253796:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788841795.253836:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000031d1cda3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500635008:0@lo:101: 00010000:00010000:0.0:1788841795.253847:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: 00000000018667da/0x3de1064d33a8ae56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8ae5d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841795.253865:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: 00000000018667da/0x3de1064d33a8ae56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8ae5d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841795.255040:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000031d1cda3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500635136:0@lo:256: 00000100:00100000:0.0:1788841795.255094:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841795.255135:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a786a8d3 going to sleep for 11 seconds 00000100:00100000:1.0:1788841795.255400:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500635136 00000100:00100000:1.0:1788841795.255406:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500635136 00000100:00100000:1.0:1788841795.255449:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788841795.255456:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f0d171f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+10:5831:x1875736500635136:12345-0@lo:256: 20000000:01000000:1.0:1788841795.255473:0:5845:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788841795.255478:0:5845:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788841795.255542:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f0d171f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+10:5831:x1875736500635136:12345-0@lo:256: Request processed in 87us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841795.255550:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788841795.255622:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000031d1cda3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500635136:0@lo:256: 10000000:01000000:0.0:1788841795.256214:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788841795.256234:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: 00000000018667da/0x3de1064d33a8ae56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8ae5d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841795.256244:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: 00000000018667da/0x3de1064d33a8ae56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8ae5d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841795.256252:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3a43e8f800 from 1 10000000:01000000:0.0:1788841795.256255:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788841795.256284:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: 00000000b275e113/0x3de1064d33a8ae64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841795.256291:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: 00000000b275e113/0x3de1064d33a8ae64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841795.256299:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: 00000000b275e113/0x3de1064d33a8ae64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841795.256457:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000031d1cda3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500635264:0@lo:101: 00000100:00100000:0.0:1788841795.256493:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841795.256672:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a786a8d3 going to sleep for 11 seconds 00000100:00100000:1.0:1788841795.257513:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500635264 00000100:00100000:1.0:1788841795.257522:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500635264 00000100:00100000:1.0:1788841795.257566:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788841795.257573:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f1361a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+10:5831:x1875736500635264:12345-0@lo:101: 00010000:00010000:1.0:1788841795.257587:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841795.257603:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d515cdc8/0x3de1064d33a8ae6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8ae64 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841795.257640:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d515cdc8/0x3de1064d33a8ae6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8ae64 expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841795.257650:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d515cdc8/0x3de1064d33a8ae6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8ae64 expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841795.257659:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d515cdc8, rc 0) 00000100:00100000:1.0:1788841795.257730:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f1361a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:5831:x1875736500635264:12345-0@lo:101: Request processed in 157us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841795.257737:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788841795.257968:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000031d1cda3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500635264:0@lo:101: 00010000:00010000:0.0:1788841795.257986:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: 00000000b275e113/0x3de1064d33a8ae64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8ae6b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841795.257994:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: 00000000b275e113/0x3de1064d33a8ae64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8ae6b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841795.258066:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000031d1cda3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500635392:0@lo:501: 00000100:00100000:0.0:1788841795.258096:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841795.258165:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a786a8d3 going to sleep for 11 seconds 00000100:00100000:1.0:1788841795.259259:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500635392 00000100:00100000:1.0:1788841795.259268:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500635392 00000100:00100000:2.0:1788841795.259421:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788841795.259430:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004fd1f325 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:5831:x1875736500635392:12345-0@lo:501: 00000100:00100000:2.0:1788841795.260079:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004fd1f325 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:5831:x1875736500635392:12345-0@lo:501: Request processed in 649us (1981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841795.260088:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788841795.260223:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000031d1cda3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500635392:0@lo:501: 00000100:00100000:1.0:1788841795.260278:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b0f0524b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500635520:0@lo:503: 00000100:00100000:1.0:1788841795.260397:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841795.260436:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b6893cd7 going to sleep for 11 seconds 00000100:00100000:2.0:1788841795.260485:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500635520 00000100:00100000:2.0:1788841795.260492:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500635520 00000100:00100000:2.0:1788841795.260524:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788841795.260531:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f31b23a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:5831:x1875736500635520:12345-0@lo:503: 00000040:00080000:2.0:1788841795.260569:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788841795.260605:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f31b23a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:5831:x1875736500635520:12345-0@lo:503: Request processed in 74us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841795.260611:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788841795.260748:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b0f0524b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500635520:0@lo:503: 00000040:00080000:2.0:1788841795.265504:0:5878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788841795.265813:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788841795.265836:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788841795.265862:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: 00000000b275e113/0x3de1064d33a8ae64 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8ae6b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841795.265874:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: 00000000b275e113/0x3de1064d33a8ae64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8ae6b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841795.265919:0:5831:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788841795.265921:0:5831:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d3a43e8f800 10000000:01000000:1.0:1788841795.265936:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d3a43e8f800 10000000:01000000:1.0:1788841795.265940:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788841795.265946:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d3a43e8f800 from 1 10000000:01000000:1.0:1788841795.265949:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788841795.265987:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: 000000001f448d0a/0x3de1064d33a8ae72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841795.265995:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: 000000001f448d0a/0x3de1064d33a8ae72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841795.266003:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: 000000001f448d0a/0x3de1064d33a8ae72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841795.266026:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b0f0524b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500635648:0@lo:101: 00000100:00100000:1.0:1788841795.266109:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841795.266146:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 0000000017601e63 going to sleep for 11 seconds 00000100:00100000:2.0:1788841795.266239:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500635648 00000100:00100000:2.0:1788841795.266247:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500635648 00000100:00100000:2.0:1788841795.266294:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788841795.266398:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000977814f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:5831:x1875736500635648:12345-0@lo:101: 00010000:00010000:2.0:1788841795.266412:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841795.266424:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002df27207/0x3de1064d33a8ae79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8ae72 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841795.266446:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002df27207/0x3de1064d33a8ae79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8ae72 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841795.266463:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002df27207/0x3de1064d33a8ae79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8ae72 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841795.266472:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002df27207, rc 0) 00000100:00100000:2.0:1788841795.266519:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000977814f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:5831:x1875736500635648:12345-0@lo:101: Request processed in 217us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841795.266527:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788841795.266607:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b0f0524b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500635648:0@lo:101: 00010000:00010000:1.0:1788841795.266620:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: 000000001f448d0a/0x3de1064d33a8ae72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8ae79 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841795.266628:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: 000000001f448d0a/0x3de1064d33a8ae72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8ae79 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841795.266669:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b0f0524b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500635776:0@lo:501: 00000100:00100000:1.0:1788841795.266696:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841795.266822:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 0000000017601e63 going to sleep for 11 seconds 00000100:00100000:2.0:1788841795.268245:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500635776 00000100:00100000:2.0:1788841795.268258:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500635776 00000100:00100000:3.0:1788841795.268493:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788841795.268505:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac7ccf7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:5831:x1875736500635776:12345-0@lo:501: 00000100:00100000:3.0:1788841795.272697:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac7ccf7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:5831:x1875736500635776:12345-0@lo:501: Request processed in 4186us (5991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841795.272743:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788841795.273160:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b0f0524b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500635776:0@lo:501: 00000100:00100000:0.0:1788841795.273219:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000067020541 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500635904:0@lo:503: 00000100:00100000:0.0:1788841795.273270:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841795.273370:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ed7b8449 going to sleep for 11 seconds 00000100:00100000:2.0:1788841795.274634:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500635904 00000100:00100000:2.0:1788841795.274647:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500635904 00000100:00100000:2.0:1788841795.274724:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788841795.274734:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077ede93d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:5831:x1875736500635904:12345-0@lo:503: 00000100:00100000:2.0:1788841795.275560:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077ede93d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:5831:x1875736500635904:12345-0@lo:503: Request processed in 823us (2285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841795.275571:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788841795.275696:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000067020541 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500635904:0@lo:503: 00000100:00100000:0.0:1788841795.277111:0:5879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000067020541 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:5879:1875736500636032:0@lo:502: 00000100:00100000:0.0:1788841795.277186:0:5879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841795.277229:0:5879:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d62a7ad0 going to sleep for 11 seconds 00000100:00100000:3.0:1788841795.277454:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500636032 00000100:00100000:3.0:1788841795.277461:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500636032 00000100:00100000:3.0:1788841795.278770:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788841795.278854:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ec722d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:5879:x1875736500636032:12345-0@lo:502: 00000100:00100000:3.0:1788841795.279419:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ec722d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:5879:x1875736500636032:12345-0@lo:502: Request processed in 637us (2233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841795.279428:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788841795.279527:0:5879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000067020541 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:5879:1875736500636032:0@lo:502: 00000020:01000004:0.0:1788841795.279592:0:5879:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788841795.279608:0:5879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000c639c801) 00000020:00000080:0.0:1788841795.279628:0:5879:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788841795.279732:0:5879:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e680ca98 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788841795.279736:0:5879:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000e680ca98 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788841795.279739:0:5879:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000e680ca98 4 00010000:00080000:0.0:1788841795.279772:0:5879:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000eb77a118@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.155@tcp at head 00010000:00010000:0.0:1788841795.281477:0:5879:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788841795.281684:0:5879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788841795.281769:0:5879:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788841795.281784:0:5879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3de1064d33a8ae87 00000100:00080000:0.0:1788841795.281793:0:5879:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788841795.281797:0:5879:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000eb77a118 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:0.0:1788841795.281828:0:5879:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000067020541 x1875736500636160/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788841795.281861:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000067020541 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875736500636160:0@lo:38: 00000100:00100000:0.0:1788841795.281942:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841795.282013:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500636160 00000100:00100000:0.0:1788841795.282020:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500636160 00000100:00100000:0.0:1788841795.282060:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788841795.282067:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df980741 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875736500636160:12345-0@lo:38: 00000100:00100000:0.0:1788841795.282126:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df980741 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875736500636160:12345-0@lo:38: Request processed in 58us (185us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788841795.282133:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788841795.282167:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788841795.282174:0:3306:0:(import.c:65:import_set_state_nolock()) 00000000eb77a118 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788841795.282187:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788841795.282189:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000067020541 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875736500636160:0@lo:38: 00000100:00080000:0.0:1788841795.282218:0:5879:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788841795.288248:0:5879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006074b6bb pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:5879:1875736500636288:0@lo:502: 00000100:00100000:2.0:1788841795.288351:0:5879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841795.288400:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500636288 00000100:00100000:2.0:1788841795.288407:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500636288 00000100:00100000:2.0:1788841795.288449:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788841795.288456:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029ce3963 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:5879:x1875736500636288:12345-0@lo:502: 00000100:00100000:2.0:1788841795.288705:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029ce3963 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:5879:x1875736500636288:12345-0@lo:502: Request processed in 249us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841795.288740:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788841795.288757:0:5879:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c4eeec54 going to sleep for 11 seconds 00000100:00100000:3.0:1788841795.288784:0:5879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006074b6bb pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:5879:1875736500636288:0@lo:502: 00000040:00080000:3.0:1788841795.288814:0:5879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788841795.291772:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788841795.291837:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788841795.291859:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: 000000001f448d0a/0x3de1064d33a8ae72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8ae79 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841795.291871:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: 000000001f448d0a/0x3de1064d33a8ae72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8ae79 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788841795.291925:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788841795.291928:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788841795.291930:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788841795.291931:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788841795.291932:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788841795.291934:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788841795.291935:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788841795.291936:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788841795.291938:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788841795.291939:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788841795.291940:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788841795.291942:0:5831:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788841795.291945:0:5831:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788841795.291948:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788841795.291949:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788841795.291950:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788841795.291951:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788841795.291952:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788841795.291953:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788841795.291954:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788841795.291955:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788841795.291956:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788841795.291956:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788841795.291958:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788841795.291958:0:5831:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788841795.291988:0:5831:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788841795.292010:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be8a58f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500636416:0@lo:253: 00000100:00100000:2.0:1788841795.292116:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841795.292168:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 000000000d97eef2 going to sleep for 11 seconds 00000100:00100000:0.0:1788841795.296925:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500636416 00000100:00100000:0.0:1788841795.296945:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500636416 00000100:00100000:0.0:1788841795.297023:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788841795.297043:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c3de38a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:5831:x1875736500636416:12345-0@lo:253: 20000000:01000000:0.0:1788841795.297092:0:5845:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788841795.297104:0:5845:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788841795.354022:0:5845:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788841795.354054:0:5845:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788841795.354160:0:5866:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788841795.354180:0:5866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788841795.354199:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a6808217/0x3de1064d33a8ae8e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841795.354219:0:5866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fc991e91/0x3de1064d33a8ae5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8ae56 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841795.354226:0:5866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a6808217/0x3de1064d33a8ae8e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841795.354264:0:5866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fc991e91/0x3de1064d33a8ae5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8ae56 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841795.354278:0:5866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fc991e91/0x3de1064d33a8ae5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8ae56 expref: 12 pid: 5844 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841795.354293:0:5866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a53ebd37 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1875736500636544:0@lo:104: 00000100:00100000:2.0:1788841795.354373:0:5866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841795.354436:0:5866:0:(client.c:2715:ptlrpc_set_wait()) set 000000008b1ba8e6 going to sleep for 11 seconds 00000100:00100000:3.0:1788841795.354580:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500636544 00000100:00100000:3.0:1788841795.354587:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500636544 00000100:00100000:3.0:1788841795.354642:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788841795.354650:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082670cd0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+3:5866:x1875736500636544:12345-0@lo:104: 00010000:00010000:3.0:1788841795.354662:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: 00000000018667da/0x3de1064d33a8ae56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8ae5d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841795.354737:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788841795.354742:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082670cd0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+3:5866:x1875736500636544:12345-0@lo:104: Request processed in 94us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841795.354748:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788841795.354768:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788841795.354773:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: 00000000018667da/0x3de1064d33a8ae56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8ae5d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841795.354780:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000018667da already unused, calling callback (00000000708f64b0) 10000000:00010000:3.0:1788841795.354783:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: 00000000018667da/0x3de1064d33a8ae56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8ae5d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841795.354790:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: 00000000018667da/0x3de1064d33a8ae56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8ae5d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788841795.354796:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: 00000000018667da/0x3de1064d33a8ae56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8ae5d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788841795.354813:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788841795.354842:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: 00000000018667da/0x3de1064d33a8ae56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8ae5d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841795.354848:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788841795.354862:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: 00000000018667da/0x3de1064d33a8ae56 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8ae5d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841795.354868:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: 00000000018667da/0x3de1064d33a8ae56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8ae5d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841795.354887:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841795.354889:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841795.354891:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841795.354950:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000547cc0fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500636672:0@lo:103: 00000100:00100000:3.0:1788841795.354980:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841795.355020:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500636672 00000100:00100000:3.0:1788841795.355024:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500636672 00010000:00010000:3.0:1788841795.355051:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fc991e91/0x3de1064d33a8ae5d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8ae56 expref: 13 pid: 5844 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841795.355073:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788841795.355078:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2e21d7e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:3308:x1875736500636672:12345-0@lo:103: 00010000:00010000:3.0:1788841795.355196:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841795.355200:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fc991e91/0x3de1064d33a8ae5d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8ae56 expref: 13 pid: 5844 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841795.355210:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fc991e91/0x3de1064d33a8ae5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8ae56 expref: 13 pid: 5844 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841795.355232:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a6808217/0x3de1064d33a8ae8e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841795.355240:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a6808217/0x3de1064d33a8ae8e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788841795.355253:0:5835:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001074185s 00010000:00010000:3.0:1788841795.355256:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a6808217/0x3de1064d33a8ae8e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841795.355262:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a6808217/0x3de1064d33a8ae8e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841795.355268:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a6808217/0x3de1064d33a8ae8e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841795.355273:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a6808217/0x3de1064d33a8ae8e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841795.355277:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a6808217 already unused, calling callback (00000000645e44bd) 00010000:00010000:3.0:1788841795.355281:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a6808217/0x3de1064d33a8ae8e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841795.355286:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a6808217/0x3de1064d33a8ae8e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841795.355292:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a6808217/0x3de1064d33a8ae8e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841795.355374:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841795.355403:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2e21d7e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:3308:x1875736500636672:12345-0@lo:103: Request processed in 325us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841795.355414:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788841795.355447:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000547cc0fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500636672:0@lo:103: 00010000:00010000:2.0:1788841795.355649:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fc991e91/0x3de1064d33a8ae5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8ae56 expref: 12 pid: 5844 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841795.355662:0:5866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a53ebd37 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1875736500636544:0@lo:104: 00010000:00010000:2.0:1788841795.355675:0:5866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a6808217/0x3de1064d33a8ae8e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841795.355682:0:5866:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a6808217/0x3de1064d33a8ae8e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841795.355687:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a6808217/0x3de1064d33a8ae8e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841795.355701:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a6808217/0x3de1064d33a8ae8e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841795.381078:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c3de38a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:5831:x1875736500636416:12345-0@lo:253: Request processed in 84026us (88953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841795.381106:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788841795.381315:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be8a58f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:5831:1875736500636416:0@lo:253: 10000000:01000000:2.0:1788841795.381333:0:5831:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788841795.381336:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788841795.381338:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788841795.381339:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788841795.381340:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788841795.381341:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788841795.381342:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788841795.381343:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788841795.381345:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788841795.381346:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788841795.381347:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788841795.381349:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788841795.381350:0:5831:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788841795.381367:0:5831:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788841795.387795:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788841795.388171:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788841795.388391:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788841795.388567:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788841795.388789:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788841795.395849:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788841795.400668:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788841795.400870:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788841795.401056:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788841795.401219:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788841795.401374:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788841795.401625:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00010000:00010000:2.0:1788841795.464588:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:3.0:1788841795.536118:0:5831:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788841795.585389:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788841795.589989:0:5885:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1788841795.593346:0:5884:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788841795.593354:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788841795.602764:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788841795.608389:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788841795.610617:0:5831:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788841795.610640:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788841795.610993:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788841795.614576:0:5831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788841795.616015:0:5831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788841795.616088:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788841795.616407:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788841795.616606:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788841795.619473:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788841795.619630:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788841795.622172:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788841795.622486:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788841795.622661:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788841795.626540:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788841795.626837:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788841795.628667:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788841795.628981:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788841795.629130:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788841795.629684:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788841795.630126:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788841795.630280:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788841795.632226:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788841795.632441:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788841795.632607:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788841795.632970:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788841795.633150:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788841795.633312:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788841795.633491:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788841795.634329:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788841795.634446:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788841795.634571:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788841795.634694:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788841795.635488:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788841795.635649:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788841795.638978:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788841795.639258:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788841795.639407:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788841795.639535:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788841795.639686:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788841795.639869:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788841795.640079:0:5831:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1788841795.689674:0:5885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1788841795.822353:0:5831:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788841795.822393:0:5831:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffab9c81c63988 00100000:10000000:0.0:1788841795.822417:0:5831:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788841795.823211:0:5831:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788841795.823227:0:5831:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.155@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788841795.823240:0:5831:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788841795.823254:0:5831:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1788841795.916483:0:5885:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788841795.916591:0:5885:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788841795.916596:0:5885:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788841796.484970:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841797.506169:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841798.532438:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841799.554124:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788841800.321836:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788841800.321847:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788841800.321850:0:36:0:(import.c:65:import_set_state_nolock()) 00000000eb77a118 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788841800.321863:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000eb77a118 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:0.0:1788841800.321884:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000049aef569 x1875736500636928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788841800.321923:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000049aef569 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875736500636928:0@lo:38: 00000100:00100000:1.0:1788841800.322168:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000067020541 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500636800:0@lo:400: 00000100:00100000:1.0:1788841800.322238:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841800.322328:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500636800 00000100:00100000:1.0:1788841800.322335:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500636800 00000100:00100000:1.0:1788841800.322376:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788841800.322383:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000914ee09e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:3309:x1875736500636800:12345-0@lo:400: 00000100:00100000:1.0:1788841800.322442:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000914ee09e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:3309:x1875736500636800:12345-0@lo:400: Request processed in 59us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841800.322449:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788841800.322497:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000067020541 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500636800:0@lo:400: 00000100:00100000:0.0:1788841800.323062:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841800.323547:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500636928 00000100:00100000:1.0:1788841800.323554:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500636928 00000100:00100000:1.0:1788841800.323592:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788841800.323597:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058ac690e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1875736500636928:12345-0@lo:38: 00010000:00080000:1.0:1788841800.323621:0:5852:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 128 last 0 00000020:00000080:1.0:1788841800.323659:0:5852:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3de1064d33a8ae95 00000004:00100000:1.0:1788841800.323726:0:5852:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788841800.324031:0:5852:0:(import.c:65:import_set_state_nolock()) 00000000678cf747 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788841800.324170:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058ac690e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875736500636928:12345-0@lo:38: Request processed in 571us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841800.324178:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788841800.325069:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000049aef569 x1875736500636928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788841810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788841800.325097:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788841800.325106:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788841800.325111:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788841800.325113:0:3306:0:(import.c:65:import_set_state_nolock()) 00000000eb77a118 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788841800.325119:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000049aef569 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875736500636928:0@lo:38: 00010000:00010000:1.0:1788841800.583355:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788841801.333216:0:6128:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788841801.619002:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841802.633109:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788841803.393945:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788841803.393954:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d3a43e8f800 from 3 10000000:01000000:3.0:1788841803.393959:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788841803.394015:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: 00000000d8b5a7cb/0x3de1064d33a8ae9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841803.394028:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: 00000000d8b5a7cb/0x3de1064d33a8ae9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841803.394039:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: 00000000d8b5a7cb/0x3de1064d33a8ae9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841803.394064:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000547cc0fc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500637056:0@lo:101: 00000100:00100000:3.0:1788841803.394140:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841803.394701:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d2831d9d going to sleep for 11 seconds 00000100:00100000:0.0:1788841803.398941:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500637056 00000100:00100000:0.0:1788841803.398957:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500637056 00000100:00100000:1.0:1788841803.401953:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788841803.401967:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045fba20f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:5847:x1875736500637056:12345-0@lo:101: 00010000:00010000:1.0:1788841803.401985:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841803.402003:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002ddd2b7c/0x3de1064d33a8aea3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8ae9c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841803.402031:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ddd2b7c/0x3de1064d33a8aea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8ae9c expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841803.402041:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002ddd2b7c/0x3de1064d33a8aea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8ae9c expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841803.402049:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002ddd2b7c, rc 0) 00000100:00100000:1.0:1788841803.402129:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045fba20f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:5847:x1875736500637056:12345-0@lo:101: Request processed in 165us (7990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841803.402136:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788841803.402240:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000547cc0fc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500637056:0@lo:101: 00010000:00010000:3.0:1788841803.402260:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: 00000000d8b5a7cb/0x3de1064d33a8ae9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8aea3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841803.402289:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: 00000000d8b5a7cb/0x3de1064d33a8ae9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8aea3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841803.402352:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000547cc0fc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500637184:0@lo:256: 00000100:00100000:3.0:1788841803.402388:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841803.407591:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d2831d9d going to sleep for 11 seconds 00000100:00100000:2.0:1788841803.409396:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500637184 00000100:00100000:2.0:1788841803.409412:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500637184 00000100:00100000:2.0:1788841803.409468:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788841803.409476:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005e81795 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:5847:x1875736500637184:12345-0@lo:256: 20000000:01000000:2.0:1788841803.409516:0:5842:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788841803.409531:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788841803.409534:0:5842:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788841803.409702:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005e81795 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:5847:x1875736500637184:12345-0@lo:256: Request processed in 226us (7313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841803.409727:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788841803.410990:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000547cc0fc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500637184:0@lo:256: 10000000:01000000:3.0:1788841803.411053:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788841803.411065:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: 00000000d8b5a7cb/0x3de1064d33a8ae9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8aea3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841803.411076:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: 00000000d8b5a7cb/0x3de1064d33a8ae9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8aea3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841803.650281:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841804.681696:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841805.449367:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788841805.449397:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000547cc0fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500637312:0@lo:400: 00000100:00100000:3.0:1788841805.449470:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841805.449527:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005875e3f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500637440:0@lo:400: 00000100:00100000:3.0:1788841805.449558:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841805.449608:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500637312 00000100:00100000:3.0:1788841805.449620:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500637312 00000100:00100000:3.0:1788841805.449662:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788841805.449670:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000621e1f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:3309:x1875736500637312:12345-0@lo:400: 00000100:00100000:3.0:1788841805.449737:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000621e1f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:3309:x1875736500637312:12345-0@lo:400: Request processed in 67us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841805.449760:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788841805.449797:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500637440 00000100:00100000:3.0:1788841805.449800:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500637440 00000100:00100000:3.0:1788841805.449826:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788841805.449842:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077c3fc16 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500637440:12345-0@lo:400: 00000100:00100000:3.0:1788841805.449881:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077c3fc16 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500637440:12345-0@lo:400: Request processed in 50us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841805.449888:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788841805.449907:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005875e3f8 x1875736500637440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841805.449923:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000547cc0fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500637312:0@lo:400: 00000100:00100000:1.0:1788841805.449923:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005875e3f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500637440:0@lo:400: 00010000:00010000:2.0:1788841805.698795:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841806.725176:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788841806.741652:0:6330:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8deda2b0 20000000:00000080:2.0:1788841806.741671:0:6330:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d3a77990c00 uarg=0000000000000000 20000000:01000000:2.0:1788841806.741748:0:6330:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788841806.741756:0:6330:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788841806.741761:0:6330:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788841806.741994:0:6330:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788841806.742010:0:6330:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788841806.748461:0:6330:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788841806.748805:0:6330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788841806.748877:0:6330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788841806.748931:0:6330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788841806.748949:0:6330:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788841806.748972:0:6330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000322789a0/0x3de1064d33a8aeaa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841806.748993:0:6330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d515cdc8/0x3de1064d33a8ae6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8ae64 expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841806.749001:0:6330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000322789a0/0x3de1064d33a8aeaa lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841806.749046:0:6330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d515cdc8/0x3de1064d33a8ae6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8ae64 expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841806.749284:0:6330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d515cdc8/0x3de1064d33a8ae6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8ae64 expref: 11 pid: 5845 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841806.749312:0:6330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000547cc0fc pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6330:1875736500637568:0@lo:104: 00000100:00100000:3.0:1788841806.749792:0:6330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841806.750304:0:6330:0:(client.c:2715:ptlrpc_set_wait()) set 000000002bde244f going to sleep for 11 seconds 00000100:00100000:2.0:1788841806.750693:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500637568 00000100:00100000:2.0:1788841806.750704:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500637568 00000100:00100000:2.0:1788841806.750771:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788841806.750780:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000631cfd6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+3:6330:x1875736500637568:12345-0@lo:104: 00010000:00010000:2.0:1788841806.750796:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: 00000000b275e113/0x3de1064d33a8ae64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8ae6b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841806.750898:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788841806.750903:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000631cfd6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+3:6330:x1875736500637568:12345-0@lo:104: Request processed in 126us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841806.750910:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788841806.750975:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841806.750982:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: 00000000b275e113/0x3de1064d33a8ae64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8ae6b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841806.750989:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b275e113 already unused, calling callback (00000000708f64b0) 10000000:00010000:1.0:1788841806.750993:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: 00000000b275e113/0x3de1064d33a8ae64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8ae6b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841806.751018:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: 00000000b275e113/0x3de1064d33a8ae64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8ae6b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788841806.751025:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: 00000000b275e113/0x3de1064d33a8ae64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8ae6b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841806.751030:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788841806.751077:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: 00000000b275e113/0x3de1064d33a8ae64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8ae6b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841806.751084:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788841806.751103:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: 00000000b275e113/0x3de1064d33a8ae64 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8ae6b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841806.751109:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: 00000000b275e113/0x3de1064d33a8ae64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8ae6b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841806.751129:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841806.751131:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841806.751132:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841806.751144:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008adbfa0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500637696:0@lo:103: 00000100:00100000:1.0:1788841806.751181:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841806.751261:0:6330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000547cc0fc pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6330:1875736500637568:0@lo:104: 00010000:00010000:3.0:1788841806.751281:0:6330:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000322789a0/0x3de1064d33a8aeaa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841806.755167:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500637696 00000100:00100000:1.0:1788841806.755184:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500637696 00010000:00010000:1.0:1788841806.755223:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d515cdc8/0x3de1064d33a8ae6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8ae64 expref: 12 pid: 5845 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841806.755259:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788841806.755268:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d62ff5b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:3308:x1875736500637696:12345-0@lo:103: 00010000:00010000:1.0:1788841806.755298:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841806.755303:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d515cdc8/0x3de1064d33a8ae6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8ae64 expref: 12 pid: 5845 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841806.755315:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d515cdc8/0x3de1064d33a8ae6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8ae64 expref: 12 pid: 5845 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841806.755557:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d515cdc8/0x3de1064d33a8ae6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8ae64 expref: 12 pid: 5845 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841806.755575:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000322789a0/0x3de1064d33a8aeaa lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841806.755583:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000322789a0/0x3de1064d33a8aeaa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841806.755600:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000322789a0/0x3de1064d33a8aeaa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841806.755608:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000322789a0/0x3de1064d33a8aeaa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841806.755614:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000322789a0/0x3de1064d33a8aeaa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841806.755621:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000322789a0/0x3de1064d33a8aeaa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841806.755627:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000322789a0 already unused, calling callback (00000000645e44bd) 00010000:00010000:1.0:1788841806.755630:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000322789a0/0x3de1064d33a8aeaa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841806.755649:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000322789a0/0x3de1064d33a8aeaa lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841806.755670:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000322789a0/0x3de1064d33a8aeaa lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841806.755681:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841806.755847:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d62ff5b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:3308:x1875736500637696:12345-0@lo:103: Request processed in 580us (4665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841806.755855:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788841806.755925:0:6330:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000322789a0/0x3de1064d33a8aeaa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841806.755934:0:6330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000322789a0/0x3de1064d33a8aeaa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841806.755939:0:6330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000322789a0/0x3de1064d33a8aeaa lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841806.759723:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008adbfa0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500637696:0@lo:103: 00010000:00010000:2.0:1788841807.752264:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841808.769850:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841809.795197:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841810.562983:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000547cc0fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500637824:0@lo:400: 00000100:00100000:1.0:1788841810.563060:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841810.563186:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500637824 00000100:00100000:2.0:1788841810.563195:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500637824 00000100:00100000:2.0:1788841810.563264:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788841810.563274:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ffe137ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:3309:x1875736500637824:12345-0@lo:400: 00000100:00100000:0.0:1788841810.563455:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000128433b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875736500637952:0@lo:400: 00000100:00100000:0.0:1788841810.563490:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841810.563526:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500637952 00000100:00100000:0.0:1788841810.563530:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500637952 00000100:00100000:0.0:1788841810.563568:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788841810.563581:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049aef569 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875736500637952:12345-0@lo:400: 00000100:00100000:0.0:1788841810.563620:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049aef569 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875736500637952:12345-0@lo:400: Request processed in 40us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841810.563627:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788841810.563663:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000128433b3 x1875736500637952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841810.563675:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000128433b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875736500637952:0@lo:400: 00000100:00100000:2.0:1788841810.565634:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ffe137ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:3309:x1875736500637824:12345-0@lo:400: Request processed in 2356us (2567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841810.565644:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000547cc0fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500637824:0@lo:400: 00000100:00100000:2.0:1788841810.566058:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1788841810.819325:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788841811.591984:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788841811.592003:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3a43e8f800 from 1 10000000:01000000:2.0:1788841811.592007:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788841811.592050:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: 00000000a6808217/0x3de1064d33a8aeb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841811.592062:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: 00000000a6808217/0x3de1064d33a8aeb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841811.592072:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: 00000000a6808217/0x3de1064d33a8aeb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841811.592094:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be8a58f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500638080:0@lo:101: 00000100:00100000:2.0:1788841811.592162:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841811.592205:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 00000000593472bd going to sleep for 11 seconds 00000100:00100000:2.0:1788841811.592223:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500638080 00000100:00100000:2.0:1788841811.592231:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500638080 00000100:00100000:2.0:1788841811.592275:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788841811.592283:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007262a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:5847:x1875736500638080:12345-0@lo:101: 00010000:00010000:2.0:1788841811.592296:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841811.592308:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bca55b72/0x3de1064d33a8aeb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8aeb1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841811.592338:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bca55b72/0x3de1064d33a8aeb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8aeb1 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841811.592347:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bca55b72/0x3de1064d33a8aeb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8aeb1 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841811.592357:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bca55b72, rc 0) 00000100:00100000:2.0:1788841811.592388:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007262a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:5847:x1875736500638080:12345-0@lo:101: Request processed in 106us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841811.592394:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788841811.592435:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be8a58f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500638080:0@lo:101: 00010000:00010000:2.0:1788841811.592448:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: 00000000a6808217/0x3de1064d33a8aeb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8aeb8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841811.592455:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: 00000000a6808217/0x3de1064d33a8aeb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8aeb8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841811.592501:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be8a58f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500638208:0@lo:501: 00000100:00100000:2.0:1788841811.592522:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841811.592533:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 00000000593472bd going to sleep for 11 seconds 00000100:00100000:2.0:1788841811.592543:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500638208 00000100:00100000:2.0:1788841811.592546:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500638208 00000100:00100000:2.0:1788841811.592562:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788841811.592566:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e48137b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:5847:x1875736500638208:12345-0@lo:501: 00000100:00100000:2.0:1788841811.592824:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e48137b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:5847:x1875736500638208:12345-0@lo:501: Request processed in 256us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841811.592830:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788841811.592864:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be8a58f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500638208:0@lo:501: 00000100:00100000:2.0:1788841811.592887:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be8a58f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500638336:0@lo:503: 00000100:00100000:2.0:1788841811.592918:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841811.592929:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 00000000593472bd going to sleep for 11 seconds 00000100:00100000:2.0:1788841811.592939:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500638336 00000100:00100000:2.0:1788841811.592942:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500638336 00000100:00100000:2.0:1788841811.592959:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788841811.592963:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000147dff52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:5847:x1875736500638336:12345-0@lo:503: 00000100:00100000:2.0:1788841811.593117:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000147dff52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:5847:x1875736500638336:12345-0@lo:503: Request processed in 153us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841811.593123:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788841811.593152:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be8a58f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500638336:0@lo:503: 00000100:00100000:2.0:1788841811.593400:0:6603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be8a58f0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:6603:1875736500638464:0@lo:502: 00000100:00100000:2.0:1788841811.593430:0:6603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841811.593452:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500638464 00000100:00100000:2.0:1788841811.593455:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500638464 00000100:00100000:2.0:1788841811.593476:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788841811.593481:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b5368ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:6603:x1875736500638464:12345-0@lo:502: 00000100:00100000:2.0:1788841811.593590:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b5368ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:6603:x1875736500638464:12345-0@lo:502: Request processed in 109us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841811.593597:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788841811.593626:0:6603:0:(client.c:2715:ptlrpc_set_wait()) set 000000009f2e63e0 going to sleep for 11 seconds 00000100:00100000:2.0:1788841811.593638:0:6603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be8a58f0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:6603:1875736500638464:0@lo:502: 00000020:01000000:2.0:1788841811.593660:0:6603:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788841811.593670:0:6603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788841811.593673:0:6603:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788841811.593686:0:6603:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d3a43e8f800 00000020:00000080:2.0:1788841811.593688:0:6603:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788841811.593759:0:6603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b779180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:6603:1875736500638592:0@lo:502: 00000100:00100000:2.0:1788841811.593787:0:6603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841811.593804:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500638592 00000100:00100000:2.0:1788841811.593806:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500638592 00000100:00100000:2.0:1788841811.593823:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788841811.593828:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:6603:x1875736500638592:12345-0@lo:502: 00000100:00100000:2.0:1788841811.593903:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:6603:x1875736500638592:12345-0@lo:502: Request processed in 74us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841811.593910:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788841811.593932:0:6603:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4ff71b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788841811.593942:0:6603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b779180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:6603:1875736500638592:0@lo:502: 00000020:01000000:2.0:1788841811.593956:0:6603:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788841811.593959:0:6603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788841811.593961:0:6603:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788841811.593964:0:6603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788841811.594008:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788841811.594020:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788841811.594029:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a82045e00/0x3de1064d33a8aeb1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8aeb8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841811.594039:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a82045e00/0x3de1064d33a8aeb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8aeb8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841811.844682:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841812.868413:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788841813.752373:0:6690:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788841813.752378:0:6690:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788841813.752562:0:6690:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d3a4e19d800 00000020:01000004:3.0:1788841813.752584:0:6690:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788841813.752599:0:6690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788841813.752963:0:6690:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d3a76a8b370) 00000020:00000080:3.0:1788841813.752987:0:6690:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788841813.773316:0:6690:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788841813.773943:0:6690:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788841813.825261:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788841813.833330:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788841813.833369:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788841813.833431:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788841813.833458:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788841813.834259:0:6690:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788841813.834277:0:6690:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788841813.834293:0:6690:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3de1064d33a8aec6 00000020:01000004:2.0:1788841813.834303:0:6690:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788841813.834334:0:6690:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.155@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788841813.834339:0:6690:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788841813.834346:0:6690:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788841813.834350:0:6690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788841813.834375:0:6690:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d3a7c10b370) 00000020:00000080:2.0:1788841813.834388:0:6690:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788841813.845098:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788841813.845360:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788841813.845367:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788841813.848801:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788841813.848819:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788841813.849479:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788841813.849488:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788841813.853097:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788841813.854751:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788841813.854762:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788841813.856436:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788841813.856448:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:0.0:1788841813.892696:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841813.912883:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788841813.913170:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788841813.913176:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788841813.926375:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788841813.926395:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788841813.928503:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788841813.928525:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788841813.931506:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788841813.931864:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788841813.931872:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788841813.933345:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788841813.933418:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788841813.987843:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788841813.993854:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788841813.993864:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788841813.999976:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788841813.999998:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788841814.000637:0:6690:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788841814.000662:0:6690:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788841814.000679:0:6690:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.155@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788841814.036242:0:6690:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.155@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788841814.036286:0:6690:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.155@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788841814.036291:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788841814.036292:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788841814.036298:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788841814.036299:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788841814.036300:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788841814.036302:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788841814.036303:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788841814.036304:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788841814.036306:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788841814.036307:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788841814.036308:0:6690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788841814.036312:0:6690:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788841814.036314:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788841814.036315:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788841814.036316:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788841814.036317:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788841814.036318:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788841814.036319:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788841814.036320:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788841814.036320:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788841814.036321:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788841814.036322:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788841814.036323:0:6690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788841814.036943:0:6690:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788841814.036966:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500638720:0@lo:253: 00000100:00100000:2.0:1788841814.037038:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841814.037152:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c2900 going to sleep for 11 seconds 00000100:00100000:0.0:1788841814.048168:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500638720 00000100:00100000:0.0:1788841814.048184:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500638720 00000100:00100000:1.0:1788841814.048571:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788841814.048582:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:6690:x1875736500638720:12345-0@lo:253: 20000000:01000000:1.0:1788841814.048629:0:5842:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788841814.048658:0:5842:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788841814.048664:0:5842:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788841814.048678:0:5842:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788841814.050127:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788841814.050344:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788841814.050359:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788841814.050399:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1788841814.050407:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788841814.050435:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788841814.050486:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788841814.054240:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788841814.054276:0:5842:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.155@tcp 20000000:01000000:1.0:1788841814.054278:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.155@tcp (null) (null) (null) 00000040:00080000:1.0:1788841814.054317:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788841814.054326:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788841814.054379:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788841814.054388:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.155@tcp (null) (null) 00000040:00080000:1.0:1788841814.054420:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788841814.054429:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788841814.054461:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788841814.054511:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1788841814.058445:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788841814.058480:0:5842:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.155@tcp 20000000:01000000:1.0:1788841814.058482:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.155@tcp (null) (null) (null) 00000040:00080000:1.0:1788841814.058520:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788841814.058529:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788841814.058562:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788841814.058570:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.155@tcp (null) (null) 00000040:00080000:1.0:1788841814.058626:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788841814.058637:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788841814.058678:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1788841814.058759:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1788841814.058783:0:5842:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788841814.058786:0:5842:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788841814.058789:0:5842:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788841814.058802:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788841814.058804:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788841814.058838:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788841814.058840:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788841814.066945:0:6706:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1788841814.067034:0:6706:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1788841814.067085:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788841814.067467:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788841814.067532:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788841814.067630:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788841814.067647:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788841814.067650:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788841814.068283:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788841814.068483:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1788841814.068523:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1788841814.068581:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1788841814.068593:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788841814.068595:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788841814.072197:0:6708:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788841814.072297:0:6708:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788841814.072359:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788841814.072758:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1788841814.072801:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1788841814.072837:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1788841814.072865:0:5842:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1788841814.072868:0:5842:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1788841814.072877:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788841814.072898:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8aed4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.072916:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a40030c00/0x3de1064d33a8aded lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8ade6 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.072924:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a82044000/0x3de1064d33a8ae09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8ae02 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.072931:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a82044200/0x3de1064d33a8ae79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8ae72 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.072938:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8aed4 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.072977:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a82044200/0x3de1064d33a8ae79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8ae72 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.073005:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3a82044200/0x3de1064d33a8ae79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8ae72 expref: 12 pid: 5842 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841814.073021:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a81f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1875736500638848:0@lo:104: 00000100:00100000:3.0:1788841814.073097:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788841814.073165:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a82044000/0x3de1064d33a8ae09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8ae02 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.073172:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3a82044000/0x3de1064d33a8ae09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8ae02 expref: 12 pid: 5844 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841814.073181:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a83100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1875736500638976:0@lo:104: 00000100:00100000:3.0:1788841814.073201:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788841814.073225:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a40030c00/0x3de1064d33a8aded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8ade6 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.073231:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3a40030c00/0x3de1064d33a8aded lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8ade6 expref: 12 pid: 5842 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841814.073239:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a80700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1875736500639104:0@lo:104: 00000100:00100000:3.0:1788841814.073257:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841814.073267:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7607b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788841814.073412:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500638848 00000100:00100000:2.0:1788841814.073420:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500638848 00000100:00100000:2.0:1788841814.073454:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500638976 00000100:00100000:2.0:1788841814.073457:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500638976 00000100:00100000:2.0:1788841814.073480:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500639104 00000100:00100000:2.0:1788841814.073483:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500639104 00000100:00100000:2.0:1788841814.073498:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788841814.073506:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+5:5842:x1875736500638848:12345-0@lo:104: 00010000:00010000:2.0:1788841814.073518:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a4dc95a00/0x3de1064d33a8ae72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8ae79 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.073578:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788841814.073590:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+5:5842:x1875736500638848:12345-0@lo:104: Request processed in 85us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841814.073597:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788841814.073614:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788841814.073619:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+4:5842:x1875736500638976:12345-0@lo:104: 00010000:00010000:2.0:1788841814.073626:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a82044800/0x3de1064d33a8ae02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8ae09 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.073663:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788841814.073680:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+4:5842:x1875736500638976:12345-0@lo:104: Request processed in 62us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841814.073686:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788841814.073697:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788841814.073703:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+3:5842:x1875736500639104:12345-0@lo:104: 00010000:00010000:2.0:1788841814.073738:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8ade6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8aded expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.073766:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788841814.073770:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+3:5842:x1875736500639104:12345-0@lo:104: Request processed in 68us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841814.073776:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788841814.073792:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788841814.073798:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a4dc95a00/0x3de1064d33a8ae72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8ae79 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.073805:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a4dc95a00 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:2.0:1788841814.073809:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a4dc95a00/0x3de1064d33a8ae72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8ae79 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.073826:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a4dc95a00/0x3de1064d33a8ae72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8ae79 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788841814.073833:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a4dc95a00/0x3de1064d33a8ae72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8ae79 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841814.073851:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788841814.073879:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a4dc95a00/0x3de1064d33a8ae72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8ae79 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.073886:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788841814.073904:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a4dc95a00/0x3de1064d33a8ae72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8ae79 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.073910:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a4dc95a00/0x3de1064d33a8ae72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8ae79 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.073925:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788841814.073928:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a82044800/0x3de1064d33a8ae02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8ae09 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.073934:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a82044800 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:2.0:1788841814.073936:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a82044800/0x3de1064d33a8ae02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8ae09 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.073943:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a82044800/0x3de1064d33a8ae02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8ae09 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788841814.073949:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a82044800/0x3de1064d33a8ae02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8ae09 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841814.073959:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788841814.073973:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a82044800/0x3de1064d33a8ae02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8ae09 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.073978:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788841814.073983:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a82044800/0x3de1064d33a8ae02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8ae09 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.073988:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a82044800/0x3de1064d33a8ae02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8ae09 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.073998:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788841814.074001:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8ade6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8aded expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.074007:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a82045000 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:2.0:1788841814.074010:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8ade6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8aded expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.074017:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8ade6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8aded expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788841814.074023:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8ade6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8aded expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841814.074028:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788841814.074038:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8ade6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8aded expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.074043:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788841814.074064:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8ade6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8aded expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.074072:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8ade6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8aded expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.074087:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841814.074089:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841814.074091:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841814.074110:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b77b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500639232:0@lo:103: 00000100:00100000:2.0:1788841814.074139:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841814.074167:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788841814.074173:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b77b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500639360:0@lo:103: 00000100:00100000:2.0:1788841814.074193:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841814.074222:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b778a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500639488:0@lo:103: 00000100:00100000:2.0:1788841814.074243:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841814.074960:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500639232 00000100:00100000:2.0:1788841814.074969:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500639232 00010000:00010000:2.0:1788841814.075001:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a82044200/0x3de1064d33a8ae79 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8ae72 expref: 13 pid: 5842 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841814.075022:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500639360 00000100:00100000:2.0:1788841814.075025:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500639360 00010000:00010000:2.0:1788841814.075035:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a82044000/0x3de1064d33a8ae09 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8ae02 expref: 14 pid: 5844 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841814.075044:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500639488 00000100:00100000:2.0:1788841814.075046:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500639488 00010000:00010000:2.0:1788841814.075056:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a40030c00/0x3de1064d33a8aded lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8ade6 expref: 15 pid: 5842 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841814.075084:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788841814.075090:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b77bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:3307:x1875736500639232:12345-0@lo:103: 00010000:00010000:2.0:1788841814.075101:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788841814.075106:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a82044200/0x3de1064d33a8ae79 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8ae72 expref: 15 pid: 5842 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.075117:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a82044200/0x3de1064d33a8ae79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8ae72 expref: 15 pid: 5842 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.075135:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788841814.075178:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b77bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:3307:x1875736500639232:12345-0@lo:103: Request processed in 87us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841814.075184:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788841814.075198:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788841814.075203:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b77a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:3307:x1875736500639360:12345-0@lo:103: 00010000:00010000:2.0:1788841814.075211:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788841814.075214:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a82044000/0x3de1064d33a8ae09 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8ae02 expref: 14 pid: 5844 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.075222:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a82044000/0x3de1064d33a8ae09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8ae02 expref: 14 pid: 5844 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.075231:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788841814.075252:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b77a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:3307:x1875736500639360:12345-0@lo:103: Request processed in 48us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841814.075258:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788841814.075269:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788841814.075282:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b77a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:3309:x1875736500639488:12345-0@lo:103: 00010000:00010000:2.0:1788841814.075289:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788841814.075295:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a40030c00/0x3de1064d33a8aded lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8ade6 expref: 13 pid: 5842 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.075303:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a40030c00/0x3de1064d33a8aded lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8ade6 expref: 13 pid: 5842 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.075314:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8aed4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.075322:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8aed4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.075336:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8aed4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.075343:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8aed4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.075350:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8aed4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.075357:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8aed4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.075363:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052000 already unused, calling callback (ffffffffc1813420) 00010000:00010000:2.0:1788841814.075367:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8aed4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.075375:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8aed4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.075390:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8aed4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.075400:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788841814.075429:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b77a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:3309:x1875736500639488:12345-0@lo:103: Request processed in 148us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841814.075435:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788841814.075478:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b77b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500639360:0@lo:103: 00000100:00100000:2.0:1788841814.075486:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b77b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500639232:0@lo:103: 00000100:00100000:2.0:1788841814.075513:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b778a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500639488:0@lo:103: 00010000:00010000:1.0:1788841814.076814:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841814.077135:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a82044200/0x3de1064d33a8ae79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8ae72 expref: 12 pid: 5842 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841814.077151:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a81f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1875736500638848:0@lo:104: 00010000:00010000:3.0:1788841814.077165:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a82044000/0x3de1064d33a8ae09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8ae02 expref: 11 pid: 5844 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841814.077191:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a83100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1875736500638976:0@lo:104: 00010000:00010000:3.0:1788841814.077204:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a40030c00/0x3de1064d33a8aded lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8ade6 expref: 10 pid: 5842 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841814.077213:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a80700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1875736500639104:0@lo:104: 00010000:00010000:3.0:1788841814.077232:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8aed4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.077241:0:5842:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8aed4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.077247:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8aed4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.077252:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8aed4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788841814.077265:0:5842:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788841814.153379:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+9:6690:x1875736500638720:12345-0@lo:253: Request processed in 104788us (116330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841814.153396:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788841814.153514:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500638720:0@lo:253: 10000000:01000000:2.0:1788841814.153531:0:6690:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788841814.153534:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788841814.153537:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788841814.153538:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788841814.153539:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788841814.153541:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788841814.153542:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788841814.153544:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788841814.153545:0:6690:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788841814.153547:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788841814.153548:0:6690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788841814.153568:0:6690:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d3a4e19d800 from lustre-OST0000 10000000:01000000:2.0:1788841814.153594:0:6690:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788841814.153597:0:6690:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788841814.153604:0:6690:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d3a435699b8 local copy 10000000:01000000:2.0:1788841814.153608:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788841814.153644:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8aedb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.153691:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8aedb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.153701:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8aedb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841814.153757:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500639616:0@lo:101: 00000100:00100000:2.0:1788841814.153796:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841814.153949:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500639616 00000100:00100000:3.0:1788841814.153956:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500639616 00000100:00100000:3.0:1788841814.153999:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788841814.154009:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+9:6690:x1875736500639616:12345-0@lo:101: 00010000:00010000:3.0:1788841814.154024:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841814.154041:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8aee2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8aedb expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.154065:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8aee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8aedb expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.154088:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8aee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8aedb expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.154097:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60052000, rc 0) 00000100:00100000:3.0:1788841814.154126:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+10:6690:x1875736500639616:12345-0@lo:101: Request processed in 119us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841814.154132:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788841814.154204:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c2780 going to sleep for 11 seconds 00000100:00100000:2.0:1788841814.154218:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500639616:0@lo:101: 00010000:00010000:2.0:1788841814.154231:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8aedb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x3de1064d33a8aee2 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.154241:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8aedb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3de1064d33a8aee2 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841814.154334:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500639744:0@lo:501: 00000100:00100000:2.0:1788841814.154359:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841814.154376:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c2780 going to sleep for 11 seconds 00000100:00100000:3.0:1788841814.154431:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500639744 00000100:00100000:3.0:1788841814.154436:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500639744 00000100:00100000:3.0:1788841814.154463:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788841814.154469:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+10:6690:x1875736500639744:12345-0@lo:501: 00000100:00100000:3.0:1788841814.154690:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+10:6690:x1875736500639744:12345-0@lo:501: Request processed in 220us (329us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788841814.154697:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788841814.155086:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500639744:0@lo:501: 10000000:01000000:2.0:1788841814.155100:0:6690:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788841814.155127:0:6690:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788841814.155134:0:6690:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8aedb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3de1064d33a8aee2 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.155142:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8aedb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3de1064d33a8aee2 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.155157:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8aedb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3de1064d33a8aee2 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.155275:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788841814.155297:0:6690:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d3a4e19d800 10000000:01000000:2.0:1788841814.155301:0:6690:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788841814.155306:0:6690:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d3a435699b8 10000000:01000000:2.0:1788841814.155309:0:6690:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788841814.155312:0:6690:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d3a435699b8 from 1 10000000:01000000:2.0:1788841814.155315:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788841814.155336:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a82044800/0x3de1064d33a8aee9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.155343:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a82044800/0x3de1064d33a8aee9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.155350:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a82044800/0x3de1064d33a8aee9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841814.155363:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500639872:0@lo:101: 00000100:00100000:2.0:1788841814.155395:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841814.155427:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788841814.155565:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500639872 00000100:00100000:1.0:1788841814.155570:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500639872 00000100:00100000:1.0:1788841814.155605:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788841814.155613:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+10:6690:x1875736500639872:12345-0@lo:101: 00010000:00010000:1.0:1788841814.155622:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841814.155633:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a4dc95e00/0x3de1064d33a8aef0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8aee9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841814.155651:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a4dc95e00/0x3de1064d33a8aef0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8aee9 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841814.155660:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a4dc95e00/0x3de1064d33a8aef0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8aee9 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841814.155692:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a4dc95e00, rc 0) 00000100:00100000:1.0:1788841814.155749:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:6690:x1875736500639872:12345-0@lo:101: Request processed in 137us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841814.155756:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788841814.155912:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500639872:0@lo:101: 00010000:00010000:2.0:1788841814.155926:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a82044800/0x3de1064d33a8aee9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8aef0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.155943:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a82044800/0x3de1064d33a8aee9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8aef0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841814.155970:0:6690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788841814.156024:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a82044800/0x3de1064d33a8aee9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8aef0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.156032:0:6690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a82044800/0x3de1064d33a8aee9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8aef0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841814.156039:0:6690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788841814.156043:0:6690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788841814.156048:0:6690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788841814.156050:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788841814.156066:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a82045400/0x3de1064d33a8aef7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.156072:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a82045400/0x3de1064d33a8aef7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.156079:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a82045400/0x3de1064d33a8aef7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841814.156091:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500640000:0@lo:101: 00000100:00100000:2.0:1788841814.156117:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841814.156139:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c2b40 going to sleep for 11 seconds 00010000:00010000:3.0:1788841814.156304:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788841814.156312:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8aedb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3de1064d33a8aee2 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.156320:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a82045000 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:3.0:1788841814.156324:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8aedb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3de1064d33a8aee2 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.156333:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8aedb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x3de1064d33a8aee2 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788841814.156340:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8aedb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x3de1064d33a8aee2 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788841814.156356:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788841814.156376:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8aedb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3de1064d33a8aee2 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.156382:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788841814.156429:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500640128:0@lo:103: 00000100:00100000:2.0:1788841814.156457:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788841814.156507:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8aedb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3de1064d33a8aee2 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.156514:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8aedb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3de1064d33a8aee2 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.156527:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841814.156529:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841814.156531:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841814.156587:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500640128 00000100:00100000:0.0:1788841814.156592:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500640128 00000100:00100000:0.0:1788841814.156640:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788841814.156648:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b778a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:3310:x1875736500640128:12345-0@lo:103: 00010000:00010000:0.0:1788841814.156659:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788841814.156683:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8aee2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3de1064d33a8aedb expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841814.156695:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841814.156833:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500640000 00000100:00100000:1.0:1788841814.156848:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500640000 00000100:00100000:1.0:1788841814.156881:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788841814.156889:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:6690:x1875736500640000:12345-0@lo:101: 00010000:00010000:1.0:1788841814.156898:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841814.156911:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a4dc95a00/0x3de1064d33a8aefe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8aef7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841814.156926:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a4dc95a00/0x3de1064d33a8aefe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8aef7 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841814.156934:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a4dc95a00/0x3de1064d33a8aefe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8aef7 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841814.156951:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a4dc95a00, rc 0) 00000100:00100000:1.0:1788841814.156984:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:6690:x1875736500640000:12345-0@lo:101: Request processed in 96us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841814.156989:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788841814.157234:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b778a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:3310:x1875736500640128:12345-0@lo:103: Request processed in 586us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841814.157240:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788841814.157299:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500640128:0@lo:103: 00000100:00100000:2.0:1788841814.157328:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500640000:0@lo:101: 00010000:00010000:2.0:1788841814.157349:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a82045400/0x3de1064d33a8aef7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8aefe expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.157356:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a82045400/0x3de1064d33a8aef7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8aefe expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841814.157454:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500640256:0@lo:501: 00000100:00100000:2.0:1788841814.157481:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841814.157551:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788841814.157589:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500640256 00000100:00100000:3.0:1788841814.157593:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500640256 00000100:00100000:3.0:1788841814.157625:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788841814.157633:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:6690:x1875736500640256:12345-0@lo:501: 00000100:00100000:3.0:1788841814.158181:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:6690:x1875736500640256:12345-0@lo:501: Request processed in 548us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841814.158189:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788841814.158239:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500640256:0@lo:501: 00000100:00100000:2.0:1788841814.158268:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500640384:0@lo:503: 00000100:00100000:2.0:1788841814.158305:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841814.158364:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788841814.158400:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500640384 00000100:00100000:3.0:1788841814.158405:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500640384 00000100:00100000:3.0:1788841814.158471:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788841814.158480:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:6690:x1875736500640384:12345-0@lo:503: 00000100:00100000:3.0:1788841814.158647:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:6690:x1875736500640384:12345-0@lo:503: Request processed in 168us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841814.158654:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788841814.158746:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500640384:0@lo:503: 00000040:00080000:2.0:1788841814.159432:0:6690:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788841814.159531:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500640512:0@lo:502: 00000100:00100000:2.0:1788841814.159585:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841814.163211:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788841814.163392:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500640512 00000100:00100000:3.0:1788841814.163402:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500640512 00000100:00100000:3.0:1788841814.163459:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788841814.163470:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:6690:x1875736500640512:12345-0@lo:502: 00000100:00100000:3.0:1788841814.163969:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:6690:x1875736500640512:12345-0@lo:502: Request processed in 500us (4383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841814.163977:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788841814.165369:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500640512:0@lo:502: 00000040:00080000:2.0:1788841814.165795:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788841814.166042:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788841814.166080:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788841814.166130:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788841814.166165:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788841814.166196:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788841814.166235:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500640640:0@lo:502: 00000100:00100000:2.0:1788841814.166313:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841814.166363:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788841814.167096:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500640640 00000100:00100000:3.0:1788841814.167105:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500640640 00000100:00100000:3.0:1788841814.167147:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788841814.167156:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:6690:x1875736500640640:12345-0@lo:502: 00000100:00100000:3.0:1788841814.167376:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:6690:x1875736500640640:12345-0@lo:502: Request processed in 220us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841814.167384:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788841814.167548:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500640640:0@lo:502: 00000040:00080000:2.0:1788841814.167695:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788841814.167732:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1788841814.168415:0:6709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788841814.168423:0:6709:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788841814.168430:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788841814.168433:0:6709:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788841814.168438:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788841814.168453:0:6709:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d3a7c10cd28) 00000020:00000080:2.0:1788841814.168473:0:6709:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788841814.168478:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788841814.168537:0:6709:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d3a4e19d800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788841814.168545:0:6709:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788841814.168553:0:6709:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3de1064d33a8af0c 00010000:00010000:3.0:1788841814.183224:0:6709:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1788841814.183598:0:6709:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788841814.188812:0:6709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788841814.189513:0:6709:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788841814.197203:0:6709:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788841814.199789:0:6709:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788841814.201504:0:6709:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788841814.201517:0:6709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788841814.201524:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841814.201526:0:6709:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788841814.201530:0:6709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788841814.201534:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841814.201535:0:6709:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788841814.201538:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788841814.201540:0:6709:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788841814.201596:0:6709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788841814.201599:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841814.201601:0:6709:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788841814.201604:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788841814.201971:0:6690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788841814.201994:0:6690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788841814.202019:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a82045400/0x3de1064d33a8aef7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8aefe expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.202031:0:6690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a82045400/0x3de1064d33a8aef7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8aefe expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841814.202040:0:6690:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3a4e19d800 from 1 10000000:01000000:2.0:1788841814.202043:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788841814.202079:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8af13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.202088:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8af13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.202106:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8af13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841814.202131:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500640768:0@lo:101: 00000100:00100000:2.0:1788841814.202202:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841814.202246:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c2480 going to sleep for 11 seconds 00000100:00100000:0.0:1788841814.202411:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500640768 00000100:00100000:0.0:1788841814.202419:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500640768 00000100:00100000:0.0:1788841814.202488:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788841814.202499:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:6690:x1875736500640768:12345-0@lo:101: 00010000:00010000:0.0:1788841814.202512:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841814.202525:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a40030800/0x3de1064d33a8af1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8af13 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841814.202550:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a40030800/0x3de1064d33a8af1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8af13 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841814.202560:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a40030800/0x3de1064d33a8af1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8af13 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841814.202567:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40030800, rc 0) 00000100:00100000:3.0:1788841814.202785:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500640768:0@lo:101: 00010000:00010000:3.0:1788841814.202801:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8af13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8af1a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.202809:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8af13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8af1a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841814.202922:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500640896:0@lo:501: 00000100:00100000:3.0:1788841814.205870:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841814.205935:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a683a1600 going to sleep for 11 seconds 00000100:00100000:0.0:1788841814.207068:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:6690:x1875736500640768:12345-0@lo:101: Request processed in 4564us (4859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841814.207081:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788841814.207136:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500640896 00000100:00100000:0.0:1788841814.207144:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500640896 00000100:00100000:0.0:1788841814.207187:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788841814.207195:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:6690:x1875736500640896:12345-0@lo:501: 00000100:00100000:0.0:1788841814.207501:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:6690:x1875736500640896:12345-0@lo:501: Request processed in 305us (1640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841814.207507:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788841814.208454:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500640896:0@lo:501: 00000100:00100000:3.0:1788841814.208512:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500641024:0@lo:503: 00000100:00100000:3.0:1788841814.208574:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841814.208603:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a683a1600 going to sleep for 11 seconds 00000100:00100000:0.0:1788841814.211903:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500641024 00000100:00100000:0.0:1788841814.211918:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500641024 00000100:00100000:0.0:1788841814.212079:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788841814.212089:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49926050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:6690:x1875736500641024:12345-0@lo:503: 00000100:00100000:0.0:1788841814.212509:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49926050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:6690:x1875736500641024:12345-0@lo:503: Request processed in 421us (3934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841814.212521:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788841814.212640:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500641024:0@lo:503: 00000040:00080000:3.0:1788841814.213193:0:6690:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788841814.213288:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500641152:0@lo:502: 00000100:00100000:3.0:1788841814.213342:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841814.213382:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a683a1600 going to sleep for 11 seconds 00000100:00100000:0.0:1788841814.213582:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500641152 00000100:00100000:0.0:1788841814.213588:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500641152 00000100:00100000:0.0:1788841814.213638:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788841814.213647:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:6690:x1875736500641152:12345-0@lo:502: 00000100:00100000:0.0:1788841814.214162:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:6690:x1875736500641152:12345-0@lo:502: Request processed in 515us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841814.214170:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788841814.214255:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500641152:0@lo:502: 00000040:00080000:3.0:1788841814.214535:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788841814.214591:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788841814.214635:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500641280:0@lo:502: 00000100:00100000:3.0:1788841814.214685:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841814.214746:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a683a1600 going to sleep for 11 seconds 00000100:00100000:0.0:1788841814.215047:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500641280 00000100:00100000:0.0:1788841814.215052:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500641280 00000100:00100000:0.0:1788841814.215087:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788841814.215095:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49924850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:6690:x1875736500641280:12345-0@lo:502: 00000100:00100000:0.0:1788841814.215253:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49924850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:6690:x1875736500641280:12345-0@lo:502: Request processed in 158us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841814.215260:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788841814.215779:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500641280:0@lo:502: 00000040:00080000:3.0:1788841814.216206:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788841814.216221:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788841814.227457:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788841814.227468:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841814.227471:0:6713:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788841814.227477:0:6713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d3a4e19d800 00000020:00000080:1.0:1788841814.227480:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788841814.227495:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788841814.227502:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841814.227503:0:6713:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788841814.227506:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788841814.227625:0:6690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788841814.227649:0:6690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788841814.227678:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8af13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8af1a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.227690:0:6690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8af13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8af1a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788841814.228047:0:6690:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788841814.228050:0:6690:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d3a4e19d800 10000000:01000000:3.0:1788841814.228053:0:6690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d3a4e19d800 10000000:01000000:3.0:1788841814.228057:0:6690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788841814.228062:0:6690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d3a4e19d800 from 1 10000000:01000000:3.0:1788841814.228064:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788841814.228096:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60052400/0x3de1064d33a8af21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.228105:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a60052400/0x3de1064d33a8af21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.228115:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a60052400/0x3de1064d33a8af21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841814.228137:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500641408:0@lo:101: 00000100:00100000:3.0:1788841814.228200:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841814.228286:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a683a1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841814.231119:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500641408 00000100:00100000:0.0:1788841814.231134:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500641408 00000100:00100000:0.0:1788841814.231199:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788841814.231208:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:6690:x1875736500641408:12345-0@lo:101: 00010000:00010000:0.0:1788841814.231222:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841814.231239:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a40031600/0x3de1064d33a8af28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8af21 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841814.231266:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a40031600/0x3de1064d33a8af28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8af21 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841814.231277:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a40031600/0x3de1064d33a8af28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8af21 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841814.231299:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40031600, rc 0) 00000100:00100000:0.0:1788841814.231442:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:6690:x1875736500641408:12345-0@lo:101: Request processed in 235us (3241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841814.231449:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788841814.232248:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500641408:0@lo:101: 00010000:00010000:2.0:1788841814.232270:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a60052400/0x3de1064d33a8af21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8af28 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.232281:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a60052400/0x3de1064d33a8af21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8af28 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841814.232402:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b77b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500641536:0@lo:501: 00000100:00100000:2.0:1788841814.232449:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841814.232528:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788841814.232603:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500641536 00000100:00100000:1.0:1788841814.232917:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500641536 00000100:00100000:1.0:1788841814.233123:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788841814.233133:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:6690:x1875736500641536:12345-0@lo:501: 00000100:00100000:1.0:1788841814.233436:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:6690:x1875736500641536:12345-0@lo:501: Request processed in 304us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841814.233443:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788841814.236294:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b77b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500641536:0@lo:501: 00000100:00100000:2.0:1788841814.236366:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b77b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500641664:0@lo:503: 00000100:00100000:2.0:1788841814.236463:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841814.236518:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841814.236644:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500641664 00000100:00100000:0.0:1788841814.236653:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500641664 00000100:00100000:0.0:1788841814.236737:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788841814.236748:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49926c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:6690:x1875736500641664:12345-0@lo:503: 00000100:00100000:0.0:1788841814.236980:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49926c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:6690:x1875736500641664:12345-0@lo:503: Request processed in 234us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841814.236988:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788841814.237803:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b77b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500641664:0@lo:503: 00000040:00080000:2.0:1788841814.238125:0:6690:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788841814.238198:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b77b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500641792:0@lo:502: 00000100:00100000:2.0:1788841814.238244:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841814.238275:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841814.238744:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500641792 00000100:00100000:0.0:1788841814.238751:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500641792 00000100:00100000:0.0:1788841814.238799:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788841814.238809:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:6690:x1875736500641792:12345-0@lo:502: 00000100:00100000:0.0:1788841814.239204:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:6690:x1875736500641792:12345-0@lo:502: Request processed in 396us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841814.239212:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788841814.239367:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b77b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500641792:0@lo:502: 00000040:00080000:2.0:1788841814.239644:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788841814.239702:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788841814.240432:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788841814.240490:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788841814.240524:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788841814.240586:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788841814.240634:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788841814.240680:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788841814.241136:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788841814.241178:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788841814.241211:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788841814.241275:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788841814.241311:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788841814.241345:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788841814.241390:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788841814.241427:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788841814.241457:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788841814.241499:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788841814.241536:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788841814.241571:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788841814.241618:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788841814.241682:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788841814.241744:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788841814.241821:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788841814.241876:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788841814.241909:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788841814.243045:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788841814.243183:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788841814.243236:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b77b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500641920:0@lo:502: 00000100:00100000:2.0:1788841814.243326:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841814.243399:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788841814.243699:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500641920 00000100:00100000:1.0:1788841814.243735:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500641920 00000100:00100000:3.0:1788841814.243984:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788841814.243997:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:6690:x1875736500641920:12345-0@lo:502: 00000100:00100000:3.0:1788841814.244259:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:6690:x1875736500641920:12345-0@lo:502: Request processed in 265us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841814.244267:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788841814.244579:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b77b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500641920:0@lo:502: 00000040:00080000:2.0:1788841814.244995:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788841814.245011:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788841814.247578:0:6714:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788841814.247603:0:6714:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d3a4e5599b8) 00000020:00000080:1.0:1788841814.247912:0:6714:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1788841814.248071:0:6714:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d3a4e19d800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788841814.248076:0:6714:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d3a4e19d800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788841814.248079:0:6714:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d3a4e19d800 3 00010000:00080000:1.0:1788841814.248188:0:6714:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d3944ed1800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.155@tcp at head 00010000:00010000:0.0:1788841814.255189:0:6714:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1788841814.255482:0:6714:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788841814.255547:0:6714:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788841814.255562:0:6714:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x3de1064d33a8af36 00000100:00080000:0.0:1788841814.255574:0:6714:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788841814.255580:0:6714:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d3944ed1800 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:0.0:1788841814.255635:0:6714:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3a75ed0000 x1875736500642048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788841814.255687:0:6714:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788841814.256205:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875736500642048:0@lo:38: 00000100:00100000:1.0:1788841814.256281:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841814.256449:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788841814.256459:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b77b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875736500642176:0@lo:400: 00000100:00100000:2.0:1788841814.256491:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841814.256527:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500642048 00000100:00100000:2.0:1788841814.256534:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500642048 00000100:00100000:2.0:1788841814.256560:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500642176 00000100:00100000:2.0:1788841814.256563:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500642176 00000100:00100000:2.0:1788841814.256588:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788841814.256596:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b77b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875736500642176:12345-0@lo:400: 00000100:00100000:2.0:1788841814.256645:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b77b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875736500642176:12345-0@lo:400: Request processed in 49us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841814.256653:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788841814.256680:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788841814.256685:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875736500642048:12345-0@lo:38: 00010000:00080000:2.0:1788841814.256705:0:5850:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 142 last 0 00000020:00000080:2.0:1788841814.256754:0:5850:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3de1064d33a8af3d 00000004:00100000:2.0:1788841814.256769:0:5850:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788841814.257022:0:5850:0:(import.c:65:import_set_state_nolock()) ffff8d3944c36800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788841814.257070:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875736500642048:12345-0@lo:38: Request processed in 383us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841814.257077:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788841814.257181:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d3a7b77b800 x1875736500642176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841814.257210:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b77b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875736500642176:0@lo:400: 00010000:00080000:1.0:1788841814.257266:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d3a75ed0000 x1875736500642048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788841824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841814.257275:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788841814.257281:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788841814.257289:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788841814.257293:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788841814.257296:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8d3944ed1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788841814.257301:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875736500642048:0@lo:38: 00000040:00080000:1.0:1788841814.258235:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1788841814.258448:0:6690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788841814.258473:0:6690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788841814.258493:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60052400/0x3de1064d33a8af21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8af28 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.258503:0:6690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a60052400/0x3de1064d33a8af21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8af28 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788841814.258551:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788841814.258554:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788841814.258555:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788841814.258557:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788841814.258558:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788841814.258559:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788841814.258560:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788841814.258562:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788841814.258563:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788841814.258565:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788841814.258567:0:6690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788841814.258570:0:6690:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788841814.258573:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788841814.258574:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788841814.258575:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788841814.258576:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788841814.258578:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788841814.258579:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788841814.258580:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788841814.258581:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788841814.258582:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788841814.258583:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788841814.258584:0:6690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788841814.258606:0:6690:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788841814.258622:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b77b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500642304:0@lo:253: 00000100:00100000:2.0:1788841814.258694:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841814.258783:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841814.259239:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500642304 00000100:00100000:0.0:1788841814.259247:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500642304 00000100:00100000:0.0:1788841814.259296:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788841814.259306:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:6690:x1875736500642304:12345-0@lo:253: 20000000:01000000:0.0:1788841814.259345:0:5844:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788841814.259359:0:5844:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788841814.295363:0:5844:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788841814.295423:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788841814.299919:0:5866:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788841814.299928:0:5866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788841814.299951:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d3a82044000/0x3de1064d33a8af44 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.299970:0:5866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a4dc94800/0x3de1064d33a8aea3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8ae9c expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.299979:0:5866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d3a82044000/0x3de1064d33a8af44 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.300021:0:5866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a4dc94800/0x3de1064d33a8aea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8ae9c expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841814.300036:0:5866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3a4dc94800/0x3de1064d33a8aea3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8ae9c expref: 13 pid: 5845 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841814.300056:0:5866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b778380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1875736500642432:0@lo:104: 00000100:00100000:2.0:1788841814.300132:0:5866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841814.300248:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500642432 00000100:00100000:0.0:1788841814.300257:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500642432 00000100:00100000:0.0:1788841814.300308:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788841814.300319:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b779c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+3:5866:x1875736500642432:12345-0@lo:104: 00010000:00010000:0.0:1788841814.300333:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a60053e00/0x3de1064d33a8ae9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8aea3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841814.300346:0:5866:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c2000 going to sleep for 11 seconds 00010000:00010000:0.0:1788841814.300393:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788841814.300400:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b779c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+3:5866:x1875736500642432:12345-0@lo:104: Request processed in 84us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841814.300408:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788841814.300412:0:5866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b778380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1875736500642432:0@lo:104: 00010000:00010000:2.0:1788841814.300436:0:5866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d3a82044000/0x3de1064d33a8af44 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841814.300741:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841814.300749:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a60053e00/0x3de1064d33a8ae9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8aea3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841814.300757:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053e00 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:1.0:1788841814.300762:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a60053e00/0x3de1064d33a8ae9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8aea3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841814.300772:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a60053e00/0x3de1064d33a8ae9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8aea3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788841814.300790:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a60053e00/0x3de1064d33a8ae9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8aea3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841814.300795:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788841814.300832:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a60053e00/0x3de1064d33a8ae9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8aea3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841814.301065:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788841814.301090:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a60053e00/0x3de1064d33a8ae9c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8aea3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841814.301097:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a60053e00/0x3de1064d33a8ae9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8aea3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841814.301382:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841814.301383:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841814.301385:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841814.301394:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788841814.301409:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500642560:0@lo:103: 00000100:00100000:1.0:1788841814.302276:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841814.302461:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500642560 00000100:00100000:3.0:1788841814.302470:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500642560 00010000:00010000:3.0:1788841814.302504:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a4dc94800/0x3de1064d33a8aea3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8ae9c expref: 14 pid: 5845 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841814.302539:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788841814.302548:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4ec18850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:3307:x1875736500642560:12345-0@lo:103: 00010000:00010000:3.0:1788841814.302560:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841814.302565:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a4dc94800/0x3de1064d33a8aea3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8ae9c expref: 14 pid: 5845 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.302577:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a4dc94800/0x3de1064d33a8aea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8ae9c expref: 14 pid: 5845 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.302594:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a4dc94800/0x3de1064d33a8aea3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8ae9c expref: 14 pid: 5845 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.302609:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d3a82044000/0x3de1064d33a8af44 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.302617:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a82044000/0x3de1064d33a8af44 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788841814.302632:0:5836:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002704286s 00010000:00010000:3.0:1788841814.302648:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3a82044000/0x3de1064d33a8af44 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.302655:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3a82044000/0x3de1064d33a8af44 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.302673:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d3a82044000/0x3de1064d33a8af44 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.302680:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d3a82044000/0x3de1064d33a8af44 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.302687:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a82044000 already unused, calling callback (ffffffffc1813420) 00010000:00010000:3.0:1788841814.302691:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d3a82044000/0x3de1064d33a8af44 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.302700:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d3a82044000/0x3de1064d33a8af44 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.302745:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d3a82044000/0x3de1064d33a8af44 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841814.302755:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841814.302812:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4ec18850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:3307:x1875736500642560:12345-0@lo:103: Request processed in 265us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841814.302819:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788841814.303170:0:5866:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d3a82044000/0x3de1064d33a8af44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841814.303180:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d3a82044000/0x3de1064d33a8af44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841814.303186:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a82044000/0x3de1064d33a8af44 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841814.303765:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500642560:0@lo:103: 00000100:00100000:2.0:1788841814.306489:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:6690:x1875736500642304:12345-0@lo:253: Request processed in 47173us (47783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841814.306503:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788841814.306677:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b77b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:6690:1875736500642304:0@lo:253: 10000000:01000000:0.0:1788841814.306693:0:6690:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788841814.306697:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788841814.306699:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788841814.306700:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788841814.306701:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788841814.306702:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788841814.306703:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788841814.306705:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788841814.307216:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788841814.307217:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788841814.307220:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788841814.307221:0:6690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788841814.307238:0:6690:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788841814.314388:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788841814.314979:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788841814.315285:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788841814.315453:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788841814.315685:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788841814.316417:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788841814.318641:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788841814.470701:0:6690:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788841814.470745:0:6690:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788841814.470794:0:6690:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788841814.470870:0:6690:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.155@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788841814.470887:0:6690:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788841814.470926:0:6690:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788841814.914904:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841815.947803:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841816.966209:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841817.990383:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841819.012666:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841819.266087:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500642944:0@lo:400: 00000100:00100000:1.0:1788841819.266164:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841819.266264:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500642944 00000100:00100000:1.0:1788841819.266272:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500642944 00000100:00100000:1.0:1788841819.266330:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788841819.266339:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500642944:12345-0@lo:400: 00000100:00100000:0.0:1788841819.266617:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875736500642816:0@lo:400: 00000100:00100000:0.0:1788841819.266669:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841819.266694:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788841819.266701:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500642688:0@lo:400: 00000100:00100000:0.0:1788841819.266748:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841819.266930:0:5852:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788841819.266938:0:5852:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788841819.266964:0:5851:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788841819.266973:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500642816 00000100:00100000:0.0:1788841819.266976:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500642816 00000100:00100000:0.0:1788841819.267004:0:5851:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788841819.267012:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788841819.267018:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875736500642816:12345-0@lo:400: 00000100:00100000:0.0:1788841819.267060:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875736500642816:12345-0@lo:400: Request processed in 42us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841819.267067:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788841819.267105:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a4e0b5c00 x1875736500642816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841819.267120:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875736500642816:0@lo:400: 00000100:00100000:1.0:1788841819.267673:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500642944:12345-0@lo:400: Request processed in 1333us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841819.267681:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788841819.267704:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788841819.267730:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500642688 00000100:00100000:1.0:1788841819.267734:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500642688 00000100:00100000:1.0:1788841819.267758:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788841819.267765:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49927850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:3310:x1875736500642688:12345-0@lo:400: 00000100:00100000:1.0:1788841819.267805:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49927850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:3310:x1875736500642688:12345-0@lo:400: Request processed in 41us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841819.267811:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788841819.267847:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500642688:0@lo:400: 00010000:00080000:1.0:1788841819.267877:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a4e0b4000 x1875736500642944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841819.267887:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500642944:0@lo:400: 00010000:00010000:0.0:1788841820.034870:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841821.060913:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788841821.200628:0:7062:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:1.0:1788841821.314537:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788841821.314547:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d3a43e8f800 from 21 10000000:01000000:1.0:1788841821.314552:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788841821.314604:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a4dc94800/0x3de1064d33a8af4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841821.314616:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a4dc94800/0x3de1064d33a8af4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841821.314626:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a4dc94800/0x3de1064d33a8af4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841821.314652:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500643072:0@lo:101: 00000100:00100000:1.0:1788841821.314754:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841821.315075:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a6827ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788841821.316130:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500643072 00000100:00100000:0.0:1788841821.316142:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500643072 00000100:00100000:0.0:1788841821.316195:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788841821.316203:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:5847:x1875736500643072:12345-0@lo:101: 00010000:00010000:0.0:1788841821.316218:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841821.316234:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a40030c00/0x3de1064d33a8af52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8af4b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841821.316260:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a40030c00/0x3de1064d33a8af52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8af4b expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841821.316271:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a40030c00/0x3de1064d33a8af52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8af4b expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841821.316279:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40030c00, rc 0) 00000100:00100000:0.0:1788841821.316343:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:5847:x1875736500643072:12345-0@lo:101: Request processed in 140us (1589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841821.316350:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788841821.316412:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500643072:0@lo:101: 00010000:00010000:0.0:1788841821.316428:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a4dc94800/0x3de1064d33a8af4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8af52 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841821.316438:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a4dc94800/0x3de1064d33a8af4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8af52 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841821.316495:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500643200:0@lo:501: 00000100:00100000:0.0:1788841821.316523:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841821.316558:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a47a3d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788841821.317335:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500643200 00000100:00100000:2.0:1788841821.317343:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500643200 00000100:00100000:2.0:1788841821.318303:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788841821.318317:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:5847:x1875736500643200:12345-0@lo:501: 00000100:00100000:2.0:1788841821.319065:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:5847:x1875736500643200:12345-0@lo:501: Request processed in 748us (2537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841821.319074:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788841821.319653:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500643200:0@lo:501: 00000100:00100000:1.0:1788841821.319704:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500643328:0@lo:503: 00000100:00100000:1.0:1788841821.319784:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841821.319829:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a6827ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788841821.319957:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500643328 00000100:00100000:2.0:1788841821.319964:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500643328 00000100:00100000:2.0:1788841821.319995:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788841821.320002:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49924050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:5847:x1875736500643328:12345-0@lo:503: 00000100:00100000:2.0:1788841821.321001:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49924050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:5847:x1875736500643328:12345-0@lo:503: Request processed in 993us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841821.321011:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788841821.321582:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500643328:0@lo:503: 00000100:00100000:1.0:1788841821.321822:0:7068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:7068:1875736500643456:0@lo:502: 00000100:00100000:1.0:1788841821.321876:0:7068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841821.322749:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500643456 00000100:00100000:1.0:1788841821.322759:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500643456 00000100:00100000:1.0:1788841821.322815:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788841821.322825:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:7068:x1875736500643456:12345-0@lo:502: 00000100:00100000:1.0:1788841821.324627:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:7068:x1875736500643456:12345-0@lo:502: Request processed in 1795us (2742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841821.324641:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788841821.324798:0:7068:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a6827ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788841821.324829:0:7068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:7068:1875736500643456:0@lo:502: 00000100:00100000:1.0:1788841821.324895:0:7068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:7068:1875736500643584:0@lo:502: 00000100:00100000:1.0:1788841821.324944:0:7068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841821.325304:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500643584 00000100:00100000:2.0:1788841821.325311:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500643584 00000100:00100000:2.0:1788841821.325349:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788841821.325357:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:7068:x1875736500643584:12345-0@lo:502: 00000100:00100000:2.0:1788841821.325635:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:7068:x1875736500643584:12345-0@lo:502: Request processed in 277us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841821.325643:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788841821.329889:0:7068:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a6827ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788841821.329941:0:7068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:7068:1875736500643584:0@lo:502: 00000040:00080000:1.0:1788841821.329990:0:7068:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788841821.336044:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788841821.337062:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788841821.337077:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a4dc94800/0x3de1064d33a8af4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8af52 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841821.337230:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a4dc94800/0x3de1064d33a8af4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8af52 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841821.341044:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788841821.341053:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d3a43e8f800 from 4 10000000:01000000:0.0:1788841821.341056:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788841821.341101:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a40031000/0x3de1064d33a8af59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841821.341114:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a40031000/0x3de1064d33a8af59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841821.341124:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a40031000/0x3de1064d33a8af59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841821.341147:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500643712:0@lo:101: 00000100:00100000:0.0:1788841821.341216:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841821.341279:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a47a3d840 going to sleep for 11 seconds 00000100:00100000:3.0:1788841821.341333:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500643712 00000100:00100000:3.0:1788841821.341341:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500643712 00000100:00100000:3.0:1788841821.341399:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788841821.341409:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:5847:x1875736500643712:12345-0@lo:101: 00010000:00010000:3.0:1788841821.341422:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841821.341435:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8af60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8af59 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841821.341456:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8af60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8af59 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841821.341465:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8af60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8af59 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841821.341474:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60053e00, rc 0) 00000100:00100000:3.0:1788841821.341511:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:5847:x1875736500643712:12345-0@lo:101: Request processed in 103us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841821.341517:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788841821.341610:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500643712:0@lo:101: 00010000:00010000:0.0:1788841821.341625:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a40031000/0x3de1064d33a8af59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8af60 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841821.341646:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a40031000/0x3de1064d33a8af59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8af60 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841821.341693:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500643840:0@lo:256: 00000100:00100000:0.0:1788841821.341764:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841821.341782:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a47a3d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788841821.342344:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500643840 00000100:00100000:2.0:1788841821.342351:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500643840 00000100:00100000:2.0:1788841821.342391:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788841821.342409:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:5847:x1875736500643840:12345-0@lo:256: 20000000:01000000:2.0:1788841821.342424:0:5845:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788841821.342441:0:5845:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788841821.342444:0:5845:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788841821.343285:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:5847:x1875736500643840:12345-0@lo:256: Request processed in 874us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841821.343295:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788841821.344322:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500643840:0@lo:256: 10000000:01000000:0.0:1788841821.344386:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788841821.344396:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a40031000/0x3de1064d33a8af59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8af60 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841821.344406:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a40031000/0x3de1064d33a8af59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8af60 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841821.344415:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788841821.344418:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788841821.344421:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788841821.344449:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a40031400/0x3de1064d33a8af67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841821.344456:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a40031400/0x3de1064d33a8af67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841821.344464:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a40031400/0x3de1064d33a8af67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841821.344481:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500643968:0@lo:101: 00000100:00100000:0.0:1788841821.344550:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841821.344595:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a47a3d840 going to sleep for 11 seconds 00000100:00100000:1.0:1788841821.346641:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500643968 00000100:00100000:1.0:1788841821.346658:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500643968 00000100:00100000:1.0:1788841821.346738:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788841821.346751:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:5847:x1875736500643968:12345-0@lo:101: 00010000:00010000:1.0:1788841821.346767:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841821.346787:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a4dc95000/0x3de1064d33a8af6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8af67 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841821.346816:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a4dc95000/0x3de1064d33a8af6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8af67 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841821.346828:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a4dc95000/0x3de1064d33a8af6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8af67 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841821.346837:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a4dc95000, rc 0) 00000100:00100000:1.0:1788841821.346926:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:5847:x1875736500643968:12345-0@lo:101: Request processed in 178us (2375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841821.346933:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788841821.346968:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500643968:0@lo:101: 00010000:00010000:0.0:1788841821.346989:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a40031400/0x3de1064d33a8af67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8af6e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841821.346998:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a40031400/0x3de1064d33a8af67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8af6e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841821.347062:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500644096:0@lo:501: 00000100:00100000:0.0:1788841821.347097:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841821.347143:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a47a3d840 going to sleep for 11 seconds 00000100:00100000:3.0:1788841821.347247:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500644096 00000100:00100000:3.0:1788841821.347253:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500644096 00000100:00100000:3.0:1788841821.347289:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788841821.347297:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:5847:x1875736500644096:12345-0@lo:501: 00000100:00100000:3.0:1788841821.347570:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:5847:x1875736500644096:12345-0@lo:501: Request processed in 273us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841821.347577:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788841821.348282:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500644096:0@lo:501: 00000100:00100000:1.0:1788841821.348322:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500644224:0@lo:503: 00000100:00100000:1.0:1788841821.348369:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841821.349240:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a6827ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788841821.351147:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500644224 00000100:00100000:0.0:1788841821.351161:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500644224 00000100:00100000:0.0:1788841821.351215:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788841821.351226:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:5847:x1875736500644224:12345-0@lo:503: 00000100:00100000:0.0:1788841821.351650:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:5847:x1875736500644224:12345-0@lo:503: Request processed in 424us (3279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841821.351657:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788841821.351758:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500644224:0@lo:503: 00000100:00100000:0.0:1788841821.354080:0:7070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:7070:1875736500644352:0@lo:502: 00000100:00100000:0.0:1788841821.354161:0:7070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841821.354214:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500644352 00000100:00100000:0.0:1788841821.354217:0:7070:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a6120c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788841821.354222:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500644352 00000100:00100000:1.0:1788841821.354274:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788841821.354284:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:7070:x1875736500644352:12345-0@lo:502: 00000100:00100000:1.0:1788841821.354640:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:7070:x1875736500644352:12345-0@lo:502: Request processed in 356us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841821.354648:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788841821.354773:0:7070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:7070:1875736500644352:0@lo:502: 00000020:01000000:0.0:1788841821.354825:0:7070:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788841821.354833:0:7070:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788841821.354848:0:7070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788841821.354850:0:7070:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788841821.354857:0:7070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788841821.354862:0:7070:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.155@tcp to nid 0x20000c0a8cc9b (192.168.204.155@tcp) 00000020:01000000:0.0:1788841821.354885:0:7070:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788841821.354887:0:7070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788841821.354912:0:7070:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d3a75f24d28) 00000020:00000080:0.0:1788841821.354946:0:7070:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1788841821.354955:0:7070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788841821.355043:0:7070:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788841821.355050:0:7070:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788841821.355058:0:7070:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3de1064d33a8af7c 00010000:00080000:0.0:1788841821.355090:0:7070:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d3a75ee2800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.155@tcp at head 00010000:00010000:0.0:1788841821.355338:0:7070:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788841821.484054:0:7070:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788841821.484083:0:7070:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788841821.484760:0:7070:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788841821.486412:0:7070:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788841821.486484:0:7070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788841821.486566:0:7070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788841821.487681:0:7080:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788841821.487688:0:7080:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788841821.488958:0:7070:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788841821.488972:0:7070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788841821.489007:0:7070:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788841821.489030:0:7070:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3de1064d33a8af83 00000100:00080000:2.0:1788841821.489041:0:7070:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788841821.489048:0:7070:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d3a75ee2800 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:2.0:1788841821.489083:0:7070:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3a7b778380 x1875736500644480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788841821.489113:0:7070:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788841821.489187:0:7070:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788841821.489198:0:7070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788841821.489200:0:7070:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788841821.489204:0:7070:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788841821.489208:0:7070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788841821.489210:0:7070:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788841821.489213:0:7070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788841821.489215:0:7070:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788841821.489221:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875736500644608:0@lo:400: 00000100:00100000:2.0:1788841821.489243:0:7070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b778000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:7070:1875736500644864:0@lo:502: 00000100:00100000:0.0:1788841821.489296:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841821.489309:0:7070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841821.489391:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b778380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875736500644480:0@lo:8: 00000100:00100000:1.0:1788841821.489429:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841821.489509:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500644736:0@lo:400: 00000100:00100000:0.0:1788841821.489552:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841821.494992:0:7070:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a6a014d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788841821.495037:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500644480 00000100:00100000:0.0:1788841821.495037:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500644608 00000100:00100000:2.0:1788841821.495047:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500644480 00000100:00100000:0.0:1788841821.495047:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500644608 00000100:00100000:0.0:1788841821.495095:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500644736 00000100:00100000:0.0:1788841821.495098:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500644736 00000100:00100000:2.0:1788841821.495105:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788841821.495114:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1875736500644480:12345-0@lo:8: 00000100:00100000:0.0:1788841821.495130:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788841821.495138:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875736500644608:12345-0@lo:400: 00010000:00080000:2.0:1788841821.495145:0:6693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 149 last 0 00000020:00000080:2.0:1788841821.495187:0:6693:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3de1064d33a8af8a 00002000:00100000:2.0:1788841821.495230:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d3944c33000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113972 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788841821.495236:0:6693:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1788841821.495240:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1788841821.495250:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875736500644608:12345-0@lo:400: Request processed in 111us (5953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841821.495258:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788841821.495274:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788841821.495282:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500644736:12345-0@lo:400: 00000100:00100000:0.0:1788841821.495321:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500644736:12345-0@lo:400: Request processed in 40us (5768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841821.495328:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788841821.495353:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500644864 00000100:00100000:0.0:1788841821.495358:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500644864 00000100:00100000:0.0:1788841821.495388:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00002000:00100000:2.0:1788841821.495391:0:6693:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788841821.495396:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:7070:x1875736500644864:12345-0@lo:502: 00002000:00080000:2.0:1788841821.495601:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788841821.495629:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8d3944c34000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788841821.495680:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875736500644480:12345-0@lo:8: Request processed in 565us (6250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841821.495687:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788841821.495700:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:7070:x1875736500644864:12345-0@lo:502: Request processed in 304us (6390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841821.495728:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1788841821.495816:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788841821.495858:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a75ed2d80 x1875736500644736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841821.495873:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500644736:0@lo:400: 00010000:00080000:0.0:1788841821.495909:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a75ed3100 x1875736500644608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841821.495919:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875736500644608:0@lo:400: 00000100:00100000:0.0:1788841821.495943:0:7070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b778000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:7070:1875736500644864:0@lo:502: 00000020:01000000:0.0:1788841821.495974:0:7070:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788841821.495982:0:7070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788841821.495990:0:7070:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788841821.495996:0:7070:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1788841821.496129:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1788841821.496145:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788841821.496154:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a40031400/0x3de1064d33a8af67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8af6e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841821.496166:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a40031400/0x3de1064d33a8af67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8af6e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841821.496176:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788841821.496178:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d3a435699b8 from 1 10000000:01000000:0.0:1788841821.496181:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788841821.496209:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8af91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841821.496217:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8af91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841821.496226:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8af91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841821.496244:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500644992:0@lo:101: 00000100:00100000:0.0:1788841821.496281:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841821.496310:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a465d0480 going to sleep for 11 seconds 00000100:00100000:0.0:1788841821.496326:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500644992 00000100:00100000:0.0:1788841821.496330:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500644992 00000100:00100000:0.0:1788841821.496354:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788841821.496362:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:5847:x1875736500644992:12345-0@lo:101: 00010000:00010000:0.0:1788841821.496371:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841821.496390:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a40031800/0x3de1064d33a8af98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8af91 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841821.496413:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a40031800/0x3de1064d33a8af98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8af91 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841821.496424:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a40031800/0x3de1064d33a8af98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8af91 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841821.496432:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40031800, rc 0) 00000100:00100000:0.0:1788841821.496464:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:5847:x1875736500644992:12345-0@lo:101: Request processed in 102us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841821.496470:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788841821.496498:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500644992:0@lo:101: 00010000:00010000:0.0:1788841821.496510:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8af91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8af98 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841821.496519:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8af91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8af98 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841821.496571:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500645120:0@lo:501: 00000100:00100000:0.0:1788841821.496595:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841821.496609:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a465d0480 going to sleep for 11 seconds 00000100:00100000:0.0:1788841821.496622:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500645120 00000100:00100000:0.0:1788841821.496625:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500645120 00000100:00100000:0.0:1788841821.496644:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788841821.496650:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:5847:x1875736500645120:12345-0@lo:501: 00000100:00100000:0.0:1788841821.496857:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:5847:x1875736500645120:12345-0@lo:501: Request processed in 206us (259us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788841821.496873:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788841821.496908:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500645120:0@lo:501: 10000000:01000000:0.0:1788841821.496932:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788841821.496938:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8af91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8af98 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841821.496946:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8af91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8af98 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1788841821.496959:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a7b778380 x1875736500644480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788841831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841821.496970:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788841821.496983:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788841821.496991:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788841821.496996:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788841821.496999:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8d3a75ee2800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788841821.497013:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788841821.497020:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b778380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875736500644480:0@lo:8: 00000004:00080000:2.0:1788841821.497042:0:7080:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788841821.497156:0:7080:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 149654445979ns, next at 0ns, rc = 0 00000004:00080000:3.0:1788841821.572079:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788841821.572086:0:7081:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788841821.572245:0:7081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b779880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7081:1875736500645376:0@lo:7: 00000100:00100000:2.0:1788841821.572323:0:7081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841821.572377:0:7081:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a48d280c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788841821.572399:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b778380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500645248:0@lo:13: 00000100:00100000:3.0:1788841821.572410:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500645376 00000100:00100000:3.0:1788841821.572418:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500645376 00000100:00100000:2.0:1788841821.572429:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841821.572478:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788841821.572496:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7081:x1875736500645376:12345-0@lo:7: 00002000:00080000:3.0:1788841821.594223:0:6696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788841821.594231:0:6696:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788841821.594334:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7081:x1875736500645376:12345-0@lo:7: Request processed in 21837us (22007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841821.594345:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788841821.594395:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500645248 00000100:00100000:3.0:1788841821.594402:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500645248 00010000:00080000:2.0:1788841821.594409:0:7081:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a7b779880 x1875736500645376/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788841837 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841821.594425:0:7081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b779880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7081:1875736500645376:0@lo:7: 00000100:00100000:3.0:1788841821.594438:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000004:00080000:2.0:1788841821.594443:0:7081:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788841821.594448:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875736500645248:12345-0@lo:13: 00002000:00000024:3.0:1788841821.594472:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788841821.594505:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875736500645248:12345-0@lo:13: Request processed in 60us (22077us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841821.594512:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788841821.594544:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788841821.594609:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a7b778380 x1875736500645248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841821.594622:0:7081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b779880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7081:1875736500645504:0@lo:5: 00000100:00100000:3.0:1788841821.594627:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b778380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500645248:0@lo:13: 00000100:00100000:2.0:1788841821.594664:0:7081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841821.594737:0:7081:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a48d280c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788841821.597092:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500645504 00000100:00100000:3.0:1788841821.597109:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500645504 00000100:00100000:3.0:1788841821.597164:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788841821.597174:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7081:x1875736500645504:12345-0@lo:5: 00002000:00080000:3.0:1788841821.597206:0:6695:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788841821.597211:0:6695:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788841821.597621:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7081:x1875736500645504:12345-0@lo:5: Request processed in 448us (2956us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788841821.597630:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788841821.600055:0:7081:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a7b779880 x1875736500645504/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788841837 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841821.600077:0:7081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b779880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7081:1875736500645504:0@lo:5: 00000004:00080000:2.0:1788841821.600092:0:7081:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788841821.600956:0:7081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b77ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7081:1875736500645632:0@lo:700: 00000100:00100000:2.0:1788841821.601026:0:7081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841821.601063:0:7081:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a49b6b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788841821.601876:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500645632 00000100:00100000:2.0:1788841821.601887:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500645632 00000100:00100000:2.0:1788841821.601953:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788841821.601963:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b778380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7081:x1875736500645632:12345-0@lo:700: 00000100:00100000:2.0:1788841821.602012:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b778000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6702:1875736500645760:0@lo:700: 00000100:00100000:2.0:1788841821.602061:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841821.602085:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a48d280c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841821.603405:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500645760 00000100:00100000:0.0:1788841821.603416:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500645760 00000100:00100000:0.0:1788841821.603473:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788841821.603483:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b77b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6702:x1875736500645760:12345-0@lo:700: 40000000:02000000:2.0:1788841821.684207:0:5857:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1788841821.704914:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b77b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6702:x1875736500645760:12345-0@lo:700: Request processed in 101422us (102842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841821.704931:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788841821.705121:0:6702:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a7b778000 x1875736500645760/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788841837 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841821.705137:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b778000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6702:1875736500645760:0@lo:700: 40000000:02000000:3.0:1788841821.705151:0:6702:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1788841821.853369:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b778380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7081:x1875736500645632:12345-0@lo:700: Request processed in 251398us (252333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841821.853389:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00100000:2.0:1788841821.853450:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788841821.853468:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00010000:00080000:2.0:1788841821.853513:0:7081:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a7b77ad80 x1875736500645632/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788841837 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841821.853539:0:7081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b77ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7081:1875736500645632:0@lo:700: 00000004:02000040:2.0:1788841821.941302:0:7081:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1788841821.948213:0:7081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a82680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7081:1875736500645888:0@lo:5: 00000100:00100000:3.0:1788841821.948312:0:7081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841821.948375:0:7081:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c2840 going to sleep for 11 seconds 00000100:00100000:2.0:1788841821.948412:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500645888 00000100:00100000:2.0:1788841821.948421:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500645888 00000100:00100000:2.0:1788841821.948478:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788841821.948489:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7081:x1875736500645888:12345-0@lo:5: 00002000:00080000:3.0:1788841821.956410:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788841821.956430:0:6693:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1788841821.963051:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7081:x1875736500645888:12345-0@lo:5: Request processed in 14553us (14728us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788841821.963065:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788841821.963274:0:7081:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a76a82680 x1875736500645888/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788841837 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841821.963288:0:7081:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788841821.963302:0:7081:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8d3a76a82680 x1875736500645888/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788841837 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841821.963332:0:7081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a82680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7081:1875736500645888:0@lo:5: 00000004:00080000:2.0:1788841821.963347:0:7081:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1788841822.081992:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841823.110994:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841824.132604:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841825.153998:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788841825.996804:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1788841826.181641:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841826.945944:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788841826.945966:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b779880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500646016:0@lo:400: 00000100:00100000:2.0:1788841826.946046:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841826.946121:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500646016 00000100:00100000:2.0:1788841826.946128:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500646016 00000100:00100000:2.0:1788841826.946168:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788841826.946176:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:3308:x1875736500646016:12345-0@lo:400: 00000100:00100000:2.0:1788841826.946220:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:3308:x1875736500646016:12345-0@lo:400: Request processed in 44us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841826.946226:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788841826.946290:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b779880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500646016:0@lo:400: 00000100:00100000:2.0:1788841826.946322:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b779880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875736500646144:0@lo:400: 00000100:00100000:2.0:1788841826.946344:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841826.946367:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500646144 00000100:00100000:2.0:1788841826.946370:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500646144 00000100:00100000:2.0:1788841826.946393:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788841826.946398:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b77ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875736500646144:12345-0@lo:400: 00000100:00100000:2.0:1788841826.946440:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b77ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875736500646144:12345-0@lo:400: Request processed in 42us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841826.946446:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788841826.946484:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a7b779880 x1875736500646144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841826.946496:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b779880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875736500646144:0@lo:400: 00000100:00100000:2.0:1788841826.946531:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b779880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500646272:0@lo:400: 00000100:00100000:2.0:1788841826.946553:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841826.946577:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500646272 00000100:00100000:2.0:1788841826.946580:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500646272 00000100:00100000:2.0:1788841826.946606:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788841826.946612:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b77bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500646272:12345-0@lo:400: 00000100:00100000:2.0:1788841826.946641:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b77bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500646272:12345-0@lo:400: Request processed in 29us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841826.946646:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788841826.946667:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a7b779880 x1875736500646272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841826.946676:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b779880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500646272:0@lo:400: 00000100:00100000:2.0:1788841826.946697:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788841826.946701:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b779880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500646400:0@lo:400: 00000100:00100000:2.0:1788841826.946751:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841826.953914:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b77a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500646528:0@lo:13: 00000100:00100000:2.0:1788841826.953995:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841826.964821:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500646528 00000100:00100000:3.0:1788841826.964840:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500646528 00000100:00100000:3.0:1788841826.964908:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788841826.964921:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500646528:12345-0@lo:13: 00002000:00000024:3.0:1788841826.964957:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788841826.965459:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500646528:12345-0@lo:13: Request processed in 150us (11072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841826.965468:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788841826.965527:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a7b77a680 x1875736500646528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841826.965539:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788841826.965576:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b77a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500646528:0@lo:13: 00000100:00080000:0.0:1788841826.969967:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788841826.969976:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788841826.972290:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500646400 00000100:00100000:2.0:1788841826.972301:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500646400 00000100:00100000:3.0:1788841826.972705:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788841826.972959:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b77a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500646400:12345-0@lo:400: 00000100:00100000:3.0:1788841826.973308:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b77a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500646400:12345-0@lo:400: Request processed in 447us (26553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841826.973315:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788841826.973394:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a7b779880 x1875736500646400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841826.973410:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b779880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500646400:0@lo:400: 00010000:00010000:2.0:1788841827.201888:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841828.226551:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841829.255800:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841830.277544:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841831.298831:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841832.066135:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b779880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500646656:0@lo:13: 00000100:00100000:3.0:1788841832.066233:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841832.068776:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500646656 00000100:00100000:2.0:1788841832.068799:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500646656 00000100:00100000:3.0:1788841832.069379:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500647040:0@lo:400: 00000100:00100000:3.0:1788841832.069480:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841832.069530:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875736500646912:0@lo:400: 00000100:00100000:0.0:1788841832.069623:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841832.069666:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788841832.069675:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788841832.069681:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500646656:12345-0@lo:13: 00000100:00100000:0.0:1788841832.069688:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500646784:0@lo:400: 00000100:00100000:0.0:1788841832.069750:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788841832.069766:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788841832.069813:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788841832.069840:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500647040 00000100:00100000:3.0:1788841832.069846:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500646656:12345-0@lo:13: Request processed in 167us (3609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841832.069858:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788841832.069860:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500647040 00010000:00080000:3.0:1788841832.069924:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a7b779880 x1875736500646656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841832.069931:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500646912 00000100:00100000:0.0:1788841832.069937:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500646912 00000100:00100000:3.0:1788841832.069960:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b779880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500646656:0@lo:13: 00000100:00100000:2.0:1788841832.070491:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788841832.070508:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500647040:12345-0@lo:400: 00000100:00100000:2.0:1788841832.070569:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500647040:12345-0@lo:400: Request processed in 70us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841832.071017:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788841832.071040:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788841832.071049:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875736500646912:12345-0@lo:400: 00000100:00100000:0.0:1788841832.071235:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500646784 00000100:00100000:0.0:1788841832.071244:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500646784 00000100:00100000:0.0:1788841832.071289:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788841832.071298:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:3310:x1875736500646784:12345-0@lo:400: 00000100:00100000:2.0:1788841832.071529:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875736500646912:12345-0@lo:400: Request processed in 480us (1904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841832.071538:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788841832.072220:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a76a81500 x1875736500647040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841832.072240:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500647040:0@lo:400: 00000100:00100000:0.0:1788841832.072762:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:3310:x1875736500646784:12345-0@lo:400: Request processed in 1456us (3002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841832.072778:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788841832.072820:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500646784:0@lo:400: 00000100:00080000:0.0:1788841832.072843:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788841832.072844:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a76a83800 x1875736500646912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841832.072857:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875736500646912:0@lo:400: 00010000:00010000:0.0:1788841832.322655:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788841832.553908:0:7624:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788841832.553913:0:7624:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788841832.554058:0:7624:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d3944ec2800 00000020:01000004:3.0:1788841832.554077:0:7624:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788841832.554091:0:7624:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788841832.554115:0:7624:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d3a75dd8000) 00000020:00000080:3.0:1788841832.554138:0:7624:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788841832.567891:0:7624:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788841832.568187:0:7624:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788841832.585697:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788841832.590447:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788841832.590483:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788841832.590540:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788841832.590564:0:7624:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788841832.590943:0:7624:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788841832.590956:0:7624:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788841832.590970:0:7624:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3de1064d33a8afa6 00000020:01000004:2.0:1788841832.590979:0:7624:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788841832.591007:0:7624:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.155@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788841832.591012:0:7624:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788841832.591017:0:7624:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788841832.591039:0:7624:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788841832.591043:0:7624:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.155@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788841832.615957:0:7624:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.155@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788841832.616017:0:7624:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.155@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788841832.616022:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788841832.616023:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788841832.616025:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788841832.616026:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788841832.616027:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788841832.616029:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788841832.616030:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788841832.616032:0:7624:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788841832.616033:0:7624:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788841832.616035:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788841832.616036:0:7624:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788841832.616040:0:7624:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788841832.616043:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788841832.616044:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788841832.616045:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788841832.616046:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788841832.616047:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788841832.616048:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788841832.616049:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788841832.616050:0:7624:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788841832.616051:0:7624:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788841832.616052:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788841832.616053:0:7624:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788841832.616079:0:7624:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788841832.616098:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500647168:0@lo:253: 00000100:00100000:3.0:1788841832.616176:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841832.616776:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4ea5a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788841832.619691:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500647168 00000100:00100000:2.0:1788841832.619759:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500647168 00000100:00100000:2.0:1788841832.619856:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788841832.619868:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:7624:x1875736500647168:12345-0@lo:253: 20000000:01000000:2.0:1788841832.619903:0:5845:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788841832.619907:0:5845:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788841832.619912:0:5845:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788841832.619916:0:5845:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1788841832.621056:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788841832.621298:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788841832.621328:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788841832.621370:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788841832.621383:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788841832.621413:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788841832.621461:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788841832.621862:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788841832.621884:0:5845:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.155@tcp 20000000:01000000:2.0:1788841832.621887:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.155@tcp (null) (null) (null) 00000040:00080000:2.0:1788841832.621923:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788841832.621931:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788841832.621980:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788841832.621988:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.155@tcp (null) (null) 00000040:00080000:2.0:1788841832.622020:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788841832.622029:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788841832.622058:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788841832.622125:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788841832.630427:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1788841832.630462:0:5845:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.155@tcp 20000000:01000000:2.0:1788841832.630465:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.155@tcp (null) (null) (null) 00000040:00080000:2.0:1788841832.630505:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1788841832.630513:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788841832.630545:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1788841832.630553:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.155@tcp (null) (null) 00000040:00080000:2.0:1788841832.630668:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1788841832.630680:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788841832.630991:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1788841832.631033:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1788841832.631051:0:5845:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788841832.631054:0:5845:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788841832.631058:0:5845:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788841832.631072:0:5845:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788841832.631075:0:5845:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788841832.631113:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788841832.631116:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788841832.634775:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788841832.635281:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788841832.635348:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788841832.635437:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788841832.635455:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788841832.635457:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788841832.636156:0:7627:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788841832.636210:0:7627:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788841832.636267:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788841832.636513:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788841832.636555:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788841832.636625:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788841832.636642:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788841832.636645:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788841832.638187:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1788841832.638270:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1788841832.638302:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788841832.638616:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788841832.638664:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788841832.638763:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1788841832.638777:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788841832.638780:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788841832.639622:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1788841832.639676:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1788841832.639779:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788841832.640126:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1788841832.640167:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1788841832.640200:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1788841832.640217:0:5845:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1788841832.640219:0:5845:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1788841832.640237:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788841832.640258:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8afad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.640276:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a4dc95a00/0x3de1064d33a8aefe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8aef7 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.640284:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a40031600/0x3de1064d33a8af28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8af21 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.640290:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a40030c00/0x3de1064d33a8af52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8af4b expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.640297:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a4dc95000/0x3de1064d33a8af6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8af67 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.640304:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a40031800/0x3de1064d33a8af98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8af91 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.640325:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8afad lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.640364:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a40031800/0x3de1064d33a8af98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8af91 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.640393:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3a40031800/0x3de1064d33a8af98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8af91 expref: 16 pid: 5845 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841832.640407:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875736500647296:0@lo:104: 00000100:00100000:0.0:1788841832.640480:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788841832.640536:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a4dc95000/0x3de1064d33a8af6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8af67 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.640555:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3a4dc95000/0x3de1064d33a8af6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8af67 expref: 16 pid: 5842 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841832.640563:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875736500647424:0@lo:104: 00000100:00100000:1.0:1788841832.640695:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788841832.640747:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500647296 00000100:00100000:1.0:1788841832.640754:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500647296 00000100:00100000:1.0:1788841832.640802:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788841832.640812:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43509450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+3:5845:x1875736500647296:12345-0@lo:104: 00010000:00010000:1.0:1788841832.640825:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8af91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8af98 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.640879:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788841832.640886:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43509450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+3:5845:x1875736500647296:12345-0@lo:104: Request processed in 76us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841832.640892:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788841832.641036:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788841832.641105:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788841832.641112:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8af91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8af98 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841832.641120:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40030000 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:3.0:1788841832.641124:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8af91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8af98 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841832.641133:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8af91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8af98 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788841832.641140:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8af91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8af98 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788841832.641146:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788841832.641174:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8af91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8af98 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841832.641181:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788841832.641200:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8af91 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8af98 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841832.641218:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8af91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8af98 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841832.641231:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841832.641233:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841832.641234:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841832.641248:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500647552:0@lo:103: 00000100:00100000:3.0:1788841832.641279:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788841832.641370:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a40030c00/0x3de1064d33a8af52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8af4b expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.641379:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3a40030c00/0x3de1064d33a8af52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8af4b expref: 16 pid: 5844 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841832.641388:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875736500647680:0@lo:104: 00000100:00100000:0.0:1788841832.641409:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788841832.642821:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a40031600/0x3de1064d33a8af28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8af21 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.642834:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3a40031600/0x3de1064d33a8af28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8af21 expref: 16 pid: 5842 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841832.642844:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875736500647808:0@lo:104: 00000100:00100000:1.0:1788841832.642893:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841832.643048:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500647424 00000100:00100000:2.0:1788841832.643055:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500647424 00000100:00100000:2.0:1788841832.643089:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500647680 00000100:00100000:2.0:1788841832.643093:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500647680 00000100:00100000:2.0:1788841832.643107:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788841832.643114:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+4:5845:x1875736500647424:12345-0@lo:104: 00010000:00010000:2.0:1788841832.643125:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a40031400/0x3de1064d33a8af67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8af6e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841832.643228:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788841832.643235:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+4:5845:x1875736500647424:12345-0@lo:104: Request processed in 121us (2198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841832.643250:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788841832.643266:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788841832.643272:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+3:5845:x1875736500647680:12345-0@lo:104: 00010000:00010000:2.0:1788841832.643281:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a4dc94800/0x3de1064d33a8af4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8af52 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.643378:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a4dc95a00/0x3de1064d33a8aefe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8aef7 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.643388:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3a4dc95a00/0x3de1064d33a8aefe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8aef7 expref: 16 pid: 5844 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841832.643397:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875736500647936:0@lo:104: 00000100:00100000:1.0:1788841832.643420:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841832.643430:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a492ef9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788841832.643450:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875736500647296:0@lo:104: 00000100:00100000:1.0:1788841832.643460:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875736500647424:0@lo:104: 00000100:00100000:1.0:1788841832.643467:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875736500647680:0@lo:104: 00010000:00010000:0.0:1788841832.645997:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788841832.646015:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a40031400/0x3de1064d33a8af67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8af6e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.646028:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40031400 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:0.0:1788841832.646032:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a40031400/0x3de1064d33a8af67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8af6e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.646041:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a40031400/0x3de1064d33a8af67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8af6e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788841832.646049:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a40031400/0x3de1064d33a8af67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8af6e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841832.646055:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788841832.646120:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a40031400/0x3de1064d33a8af67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8af6e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.646126:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788841832.646163:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a40031400/0x3de1064d33a8af67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8af6e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.646169:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a40031400/0x3de1064d33a8af67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8af6e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.646187:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788841832.646190:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a4dc94800/0x3de1064d33a8af4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8af52 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.646196:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a4dc94800 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:0.0:1788841832.646198:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a4dc94800/0x3de1064d33a8af4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8af52 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.646205:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a4dc94800/0x3de1064d33a8af4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8af52 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788841832.646211:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a4dc94800/0x3de1064d33a8af4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8af52 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841832.646216:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788841832.646229:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a4dc94800/0x3de1064d33a8af4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8af52 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.646234:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788841832.646239:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a4dc94800/0x3de1064d33a8af4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8af52 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.646254:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a4dc94800/0x3de1064d33a8af4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8af52 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.646266:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841832.646268:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841832.646269:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841832.646459:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500647808 00000100:00100000:3.0:1788841832.646468:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500647808 00000100:00100000:3.0:1788841832.646492:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500648192:0@lo:103: 00000100:00100000:3.0:1788841832.646565:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841832.646624:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788841832.646630:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500648064:0@lo:103: 00000100:00100000:3.0:1788841832.646651:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841832.646730:0:5834:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788841832.646738:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:1.0:1788841832.646843:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500647552 00000100:00100000:1.0:1788841832.646848:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500647552 00010000:00010000:1.0:1788841832.646871:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a40031800/0x3de1064d33a8af98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8af91 expref: 17 pid: 5845 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841832.646885:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500648192 00000100:00100000:1.0:1788841832.646887:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500648192 00010000:00010000:1.0:1788841832.646896:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a40030c00/0x3de1064d33a8af52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8af4b expref: 18 pid: 5844 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841832.646903:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500648064 00000100:00100000:1.0:1788841832.646905:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500648064 00010000:00010000:1.0:1788841832.646912:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a4dc95000/0x3de1064d33a8af6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8af67 expref: 19 pid: 5842 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841832.646925:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788841832.646931:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3308:x1875736500647552:12345-0@lo:103: 00010000:00010000:1.0:1788841832.646950:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841832.646956:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a40031800/0x3de1064d33a8af98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8af91 expref: 19 pid: 5845 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.646967:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a40031800/0x3de1064d33a8af98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8af91 expref: 19 pid: 5845 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.646983:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a40031800/0x3de1064d33a8af98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8af91 expref: 19 pid: 5845 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.646998:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841832.647041:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:3308:x1875736500647552:12345-0@lo:103: Request processed in 110us (5762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841832.647048:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788841832.647066:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788841832.647072:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:3310:x1875736500648192:12345-0@lo:103: 00010000:00010000:1.0:1788841832.647079:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841832.647082:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a40030c00/0x3de1064d33a8af52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8af4b expref: 17 pid: 5844 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.647089:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a40030c00/0x3de1064d33a8af52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8af4b expref: 17 pid: 5844 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.647099:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a40030c00/0x3de1064d33a8af52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8af4b expref: 17 pid: 5844 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.647107:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841832.647134:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:3310:x1875736500648192:12345-0@lo:103: Request processed in 63us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841832.647139:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788841832.647160:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788841832.647165:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:3310:x1875736500648064:12345-0@lo:103: 00010000:00010000:1.0:1788841832.647173:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841832.647177:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a4dc95000/0x3de1064d33a8af6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8af67 expref: 15 pid: 5842 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.647185:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a4dc95000/0x3de1064d33a8af6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8af67 expref: 15 pid: 5842 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.647195:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a4dc95000/0x3de1064d33a8af6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8af67 expref: 15 pid: 5842 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.647205:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841832.647228:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:3310:x1875736500648064:12345-0@lo:103: Request processed in 62us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841832.647233:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788841832.647267:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500648064:0@lo:103: 00000100:00100000:1.0:1788841832.647275:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500648192:0@lo:103: 00000100:00100000:1.0:1788841832.647438:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500647936 00000100:00100000:1.0:1788841832.647442:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500647936 00000100:00100000:1.0:1788841832.647514:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788841832.647520:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:fd738bcb-4fee-4a21-af92-bab36d5458e2+5:5845:x1875736500647808:12345-0@lo:104: 00010000:00010000:1.0:1788841832.647531:0:7630:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a60052400/0x3de1064d33a8af21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8af28 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841832.647592:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875736500647808:0@lo:104: 00010000:00010000:1.0:1788841832.647610:0:7630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788841832.647615:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:fd738bcb-4fee-4a21-af92-bab36d5458e2+5:5845:x1875736500647808:12345-0@lo:104: Request processed in 97us (4722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841832.647626:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788841832.647641:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841832.647647:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a60052400/0x3de1064d33a8af21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8af28 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.647654:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052400 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:1.0:1788841832.647659:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a60052400/0x3de1064d33a8af21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8af28 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.647666:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a60052400/0x3de1064d33a8af21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8af28 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788841832.647673:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a60052400/0x3de1064d33a8af21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8af28 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841832.647678:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788841832.647702:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a60052400/0x3de1064d33a8af21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8af28 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.647735:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788841832.647749:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a60052400/0x3de1064d33a8af21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8af28 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.647756:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a60052400/0x3de1064d33a8af21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8af28 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.647767:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841832.647769:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841832.647770:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841832.647785:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500648320:0@lo:103: 00000100:00100000:1.0:1788841832.647817:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841832.647854:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500648320 00000100:00100000:1.0:1788841832.647858:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500648320 00010000:00010000:1.0:1788841832.647872:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a40031600/0x3de1064d33a8af28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8af21 expref: 14 pid: 5842 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841832.647885:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788841832.647891:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:3307:x1875736500648320:12345-0@lo:103: 00010000:00010000:1.0:1788841832.647898:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841832.647901:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a40031600/0x3de1064d33a8af28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8af21 expref: 14 pid: 5842 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.647910:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a40031600/0x3de1064d33a8af28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8af21 expref: 14 pid: 5842 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.647921:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a40031600/0x3de1064d33a8af28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8af21 expref: 14 pid: 5842 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.647930:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841832.647955:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:3307:x1875736500648320:12345-0@lo:103: Request processed in 64us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841832.647960:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788841832.647982:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500648320:0@lo:103: 00000100:00100000:1.0:1788841832.648000:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788841832.648006:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:fd738bcb-4fee-4a21-af92-bab36d5458e2+4:5845:x1875736500647936:12345-0@lo:104: 00010000:00010000:1.0:1788841832.648014:0:7630:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a82045400/0x3de1064d33a8aef7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8aefe expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841832.648054:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875736500647936:0@lo:104: 00010000:00010000:1.0:1788841832.648084:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8afad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.648105:0:7630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788841832.648109:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:fd738bcb-4fee-4a21-af92-bab36d5458e2+4:5845:x1875736500647936:12345-0@lo:104: Request processed in 105us (4689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841832.648115:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788841832.648127:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841832.648131:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a82045400/0x3de1064d33a8aef7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8aefe expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.648137:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a82045400 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:1.0:1788841832.648141:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a82045400/0x3de1064d33a8aef7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8aefe expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.648148:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a82045400/0x3de1064d33a8aef7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8aefe expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788841832.648154:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a82045400/0x3de1064d33a8aef7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8aefe expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841832.648159:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788841832.648176:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a82045400/0x3de1064d33a8aef7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8aefe expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.648182:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788841832.648190:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a82045400/0x3de1064d33a8aef7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8aefe expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.648196:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a82045400/0x3de1064d33a8aef7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8aefe expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.648219:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841832.648221:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841832.648223:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841832.648233:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788841832.648242:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500648448:0@lo:103: 00000100:00100000:1.0:1788841832.648265:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841832.648287:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500648448 00000100:00100000:1.0:1788841832.648291:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500648448 00010000:00010000:1.0:1788841832.648304:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a4dc95a00/0x3de1064d33a8aefe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8aef7 expref: 13 pid: 5844 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841832.648331:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788841832.648337:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:3307:x1875736500648448:12345-0@lo:103: 00010000:00010000:1.0:1788841832.648343:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841832.648347:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a4dc95a00/0x3de1064d33a8aefe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8aef7 expref: 13 pid: 5844 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.648356:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a4dc95a00/0x3de1064d33a8aefe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8aef7 expref: 13 pid: 5844 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.648367:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a4dc95a00/0x3de1064d33a8aefe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8aef7 expref: 13 pid: 5844 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.648378:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8afad lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.648387:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8afad lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.648408:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8afad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.648415:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8afad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.648421:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8afad lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.648427:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8afad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.648432:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40030400 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788841832.648437:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8afad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.648444:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8afad lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.648456:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8afad lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.648466:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841832.648493:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:3307:x1875736500648448:12345-0@lo:103: Request processed in 157us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841832.648499:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788841832.648515:0:5845:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8afad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.648522:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8afad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.648535:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8afad lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788841832.648549:0:5845:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788841832.648584:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500648448:0@lo:103: 00000100:00100000:3.0:1788841832.649325:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500647552:0@lo:103: 00010000:00010000:2.0:1788841832.650460:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788841832.650475:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+3:5845:x1875736500647680:12345-0@lo:104: Request processed in 7198us (9060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841832.650485:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788841832.653446:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841832.733854:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:7624:x1875736500647168:12345-0@lo:253: Request processed in 113977us (117667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841832.733869:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788841832.734024:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500647168:0@lo:253: 10000000:01000000:3.0:1788841832.734041:0:7624:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788841832.734045:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788841832.734047:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788841832.734048:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788841832.734049:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788841832.734051:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788841832.734052:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788841832.734054:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788841832.734055:0:7624:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788841832.734072:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788841832.734074:0:7624:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788841832.734095:0:7624:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d3944ec2800 from lustre-OST0001 10000000:01000000:3.0:1788841832.734122:0:7624:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788841832.734125:0:7624:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788841832.734134:0:7624:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d3a435699b8 local copy 10000000:01000000:3.0:1788841832.734138:0:7624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788841832.734176:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60052000/0x3de1064d33a8afb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841832.734187:0:7624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.155@tcp lock: ffff8d3a60052000/0x3de1064d33a8afb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841832.734196:0:7624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a60052000/0x3de1064d33a8afb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841832.734215:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500648576:0@lo:101: 00000100:00100000:3.0:1788841832.734250:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841832.734349:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4ea5aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788841832.744550:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500648576 00000100:00100000:0.0:1788841832.744567:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500648576 00000100:00100000:2.0:1788841832.744774:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788841832.744788:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+11:7624:x1875736500648576:12345-0@lo:101: 00010000:00010000:2.0:1788841832.744807:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841832.744831:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a82045400/0x3de1064d33a8afbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8afb4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841832.744863:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a82045400/0x3de1064d33a8afbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8afb4 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841832.744875:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a82045400/0x3de1064d33a8afbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8afb4 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841832.744884:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a82045400, rc 0) 00000100:00100000:2.0:1788841832.744981:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:7624:x1875736500648576:12345-0@lo:101: Request processed in 197us (10730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841832.745002:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788841832.745121:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500648576:0@lo:101: 00010000:00010000:3.0:1788841832.745140:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a60052000/0x3de1064d33a8afb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x3de1064d33a8afbb expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841832.745150:0:7624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a60052000/0x3de1064d33a8afb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3de1064d33a8afbb expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841832.745275:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500648704:0@lo:501: 00000100:00100000:3.0:1788841832.745324:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841832.745365:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4ea5aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788841832.747546:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500648704 00000100:00100000:0.0:1788841832.747561:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500648704 00000100:00100000:0.0:1788841832.747632:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788841832.747643:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:7624:x1875736500648704:12345-0@lo:501: 00000100:00100000:0.0:1788841832.747961:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:7624:x1875736500648704:12345-0@lo:501: Request processed in 319us (2636us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788841832.747970:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788841832.748192:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500648704:0@lo:501: 10000000:01000000:3.0:1788841832.748226:0:7624:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788841832.748262:0:7624:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788841832.748270:0:7624:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60052000/0x3de1064d33a8afb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3de1064d33a8afbb expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841832.748282:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60052000/0x3de1064d33a8afb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3de1064d33a8afbb expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841832.748290:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.155@tcp lock: ffff8d3a60052000/0x3de1064d33a8afb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3de1064d33a8afbb expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841832.748321:0:7624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788841832.748344:0:7624:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d3944ec2800 10000000:01000000:3.0:1788841832.748350:0:7624:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788841832.748356:0:7624:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788841832.748359:0:7624:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788841832.748364:0:7624:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788841832.748367:0:7624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788841832.748395:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8afc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841832.748404:0:7624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8afc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841832.748489:0:7624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8afc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841832.748509:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500648832:0@lo:101: 00000100:00100000:3.0:1788841832.748544:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841832.748589:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4ea5a600 going to sleep for 11 seconds 00010000:00010000:1.0:1788841832.750562:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841832.750578:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a60052000/0x3de1064d33a8afb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3de1064d33a8afbb expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.750589:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052000 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:1.0:1788841832.750594:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a60052000/0x3de1064d33a8afb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3de1064d33a8afbb expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.750604:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a60052000/0x3de1064d33a8afb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x3de1064d33a8afbb expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788841832.750612:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a60052000/0x3de1064d33a8afb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x3de1064d33a8afbb expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841832.750617:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788841832.750661:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a60052000/0x3de1064d33a8afb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3de1064d33a8afbb expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.750667:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788841832.750748:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a60052000/0x3de1064d33a8afb4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3de1064d33a8afbb expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.750756:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a60052000/0x3de1064d33a8afb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3de1064d33a8afbb expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.750787:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841832.750789:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841832.750790:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841832.750865:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500648960:0@lo:103: 00000100:00100000:2.0:1788841832.750939:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841832.751075:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500648832 00000100:00100000:0.0:1788841832.751088:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500648832 00000100:00100000:0.0:1788841832.751145:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788841832.751156:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:7624:x1875736500648832:12345-0@lo:101: 00010000:00010000:0.0:1788841832.751169:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841832.751186:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a40031400/0x3de1064d33a8afc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8afc2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.751208:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a40031400/0x3de1064d33a8afc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8afc2 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.751218:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a40031400/0x3de1064d33a8afc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8afc2 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.751239:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40031400, rc 0) 00000100:00100000:0.0:1788841832.751283:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:7624:x1875736500648832:12345-0@lo:101: Request processed in 129us (2738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841832.751289:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788841832.752701:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500648832:0@lo:101: 00010000:00010000:3.0:1788841832.752764:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8afc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8afc9 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841832.752775:0:7624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8afc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8afc9 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841832.752899:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500649088:0@lo:501: 00000100:00100000:3.0:1788841832.752986:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841832.753028:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4ea5a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788841832.753162:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500649088 00000100:00100000:2.0:1788841832.753168:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500649088 00000100:00100000:2.0:1788841832.753208:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788841832.753217:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:7624:x1875736500649088:12345-0@lo:501: 00000100:00100000:2.0:1788841832.753510:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:7624:x1875736500649088:12345-0@lo:501: Request processed in 294us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841832.753518:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788841832.754620:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500649088:0@lo:501: 00000100:00100000:3.0:1788841832.754667:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500649216:0@lo:503: 00000100:00100000:3.0:1788841832.754770:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841832.754803:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4ea5a600 going to sleep for 11 seconds 00000100:00100000:1.0:1788841832.754833:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500648960 00000100:00100000:1.0:1788841832.754839:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500648960 00000100:00100000:1.0:1788841832.754897:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788841832.754907:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b779180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:3309:x1875736500648960:12345-0@lo:103: 00010000:00010000:1.0:1788841832.754922:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841832.754945:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a82045400/0x3de1064d33a8afbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3de1064d33a8afb4 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.754962:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841832.755006:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b779180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:3309:x1875736500648960:12345-0@lo:103: Request processed in 102us (4066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841832.755013:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788841832.755046:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500648960:0@lo:103: 00000100:00100000:2.0:1788841832.755122:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500649216 00000100:00100000:2.0:1788841832.755127:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500649216 00000100:00100000:2.0:1788841832.755152:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788841832.755159:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:7624:x1875736500649216:12345-0@lo:503: 00000100:00100000:2.0:1788841832.755366:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:7624:x1875736500649216:12345-0@lo:503: Request processed in 206us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841832.755373:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788841832.755461:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500649216:0@lo:503: 00000040:00080000:3.0:1788841832.755798:0:7624:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788841832.755872:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500649344:0@lo:502: 00000100:00100000:3.0:1788841832.756178:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841832.756209:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4ea5a600 going to sleep for 11 seconds 00000100:00100000:1.0:1788841832.758109:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500649344 00000100:00100000:1.0:1788841832.758124:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500649344 00000100:00100000:1.0:1788841832.758180:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788841832.758190:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:7624:x1875736500649344:12345-0@lo:502: 00000100:00100000:1.0:1788841832.758480:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:7624:x1875736500649344:12345-0@lo:502: Request processed in 291us (2301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841832.758489:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788841832.758606:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500649344:0@lo:502: 00000040:00080000:3.0:1788841832.759123:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788841832.759179:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788841832.759215:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788841832.759263:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788841832.759300:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788841832.759350:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788841832.759396:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500649472:0@lo:502: 00000100:00100000:3.0:1788841832.759448:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841832.759844:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4ea5a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788841832.768501:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500649472 00000100:00100000:2.0:1788841832.768518:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500649472 00000100:00100000:2.0:1788841832.768592:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788841832.768604:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:7624:x1875736500649472:12345-0@lo:502: 00000100:00100000:2.0:1788841832.769344:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:7624:x1875736500649472:12345-0@lo:502: Request processed in 730us (9883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841832.769355:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788841832.775264:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500649472:0@lo:502: 00000040:00080000:2.0:1788841832.783108:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788841832.783133:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788841832.786218:0:7632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788841832.786230:0:7632:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788841832.786237:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788841832.786239:0:7632:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788841832.786246:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788841832.786264:0:7632:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d3a7c1099b8) 00000020:00000080:2.0:1788841832.786289:0:7632:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788841832.786295:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788841832.786369:0:7632:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d3944ec2800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788841832.786377:0:7632:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788841832.786397:0:7632:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3de1064d33a8afd7 00010000:00010000:2.0:1788841832.795006:0:7632:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1788841832.795356:0:7632:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788841832.806878:0:7632:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788841832.807176:0:7632:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788841832.815404:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788841832.815934:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788841832.822522:0:7632:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788841832.822534:0:7632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788841832.822541:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841832.822548:0:7632:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788841832.822552:0:7632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788841832.822556:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841832.822557:0:7632:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788841832.822559:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788841832.822561:0:7632:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788841832.822630:0:7632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788841832.822633:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841832.822634:0:7632:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788841832.822638:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788841832.824045:0:7624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788841832.824082:0:7624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788841832.824103:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8afc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8afc9 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841832.824115:0:7624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8afc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8afc9 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841832.824123:0:7624:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3944ec2800 from 1 10000000:01000000:2.0:1788841832.824126:0:7624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788841832.824162:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a82045a00/0x3de1064d33a8afde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841832.824171:0:7624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a82045a00/0x3de1064d33a8afde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841832.824182:0:7624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a82045a00/0x3de1064d33a8afde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841832.824218:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b77aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500649600:0@lo:101: 00000100:00100000:2.0:1788841832.824292:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841832.824356:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a461e0300 going to sleep for 11 seconds 00000100:00100000:0.0:1788841832.825786:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500649600 00000100:00100000:0.0:1788841832.825798:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500649600 00000100:00100000:0.0:1788841832.825870:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788841832.825881:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:7624:x1875736500649600:12345-0@lo:101: 00010000:00010000:0.0:1788841832.825895:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841832.825913:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8afe5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8afde expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.825940:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8afe5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8afde expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.825951:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8afe5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8afde expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.825960:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40030400, rc 0) 00000100:00100000:0.0:1788841832.826037:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:7624:x1875736500649600:12345-0@lo:101: Request processed in 157us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841832.826043:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788841832.826101:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b77aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500649600:0@lo:101: 00010000:00010000:0.0:1788841832.826120:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a82045a00/0x3de1064d33a8afde lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8afe5 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.826128:0:7624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a82045a00/0x3de1064d33a8afde lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8afe5 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841832.826249:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500649728:0@lo:501: 00000100:00100000:0.0:1788841832.826284:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841832.826328:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a492ef180 going to sleep for 11 seconds 00000100:00100000:0.0:1788841832.826344:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500649728 00000100:00100000:0.0:1788841832.826348:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500649728 00000100:00100000:0.0:1788841832.826372:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788841832.826379:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:7624:x1875736500649728:12345-0@lo:501: 00000100:00100000:0.0:1788841832.826599:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:7624:x1875736500649728:12345-0@lo:501: Request processed in 220us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841832.826606:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788841832.826640:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500649728:0@lo:501: 00000100:00100000:0.0:1788841832.826666:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500649856:0@lo:503: 00000100:00100000:0.0:1788841832.826700:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841832.826735:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a492ef180 going to sleep for 11 seconds 00000100:00100000:0.0:1788841832.826748:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500649856 00000100:00100000:0.0:1788841832.826752:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500649856 00000100:00100000:0.0:1788841832.826773:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788841832.826779:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:7624:x1875736500649856:12345-0@lo:503: 00000100:00100000:0.0:1788841832.827045:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:7624:x1875736500649856:12345-0@lo:503: Request processed in 265us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841832.827052:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788841832.827095:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500649856:0@lo:503: 00000040:00080000:0.0:1788841832.827408:0:7624:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788841832.827462:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500649984:0@lo:502: 00000100:00100000:0.0:1788841832.827497:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841832.827512:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a492ef180 going to sleep for 11 seconds 00000100:00100000:0.0:1788841832.827524:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500649984 00000100:00100000:0.0:1788841832.827528:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500649984 00000100:00100000:0.0:1788841832.827549:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788841832.827554:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:7624:x1875736500649984:12345-0@lo:502: 00000100:00100000:0.0:1788841832.827685:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:7624:x1875736500649984:12345-0@lo:502: Request processed in 130us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841832.827691:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788841832.827789:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500649984:0@lo:502: 00000040:00080000:0.0:1788841832.827977:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788841832.828020:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788841832.828040:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500650112:0@lo:502: 00000100:00100000:0.0:1788841832.828072:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841832.828087:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a492ef180 going to sleep for 11 seconds 00000100:00100000:0.0:1788841832.828099:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500650112 00000100:00100000:0.0:1788841832.828102:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500650112 00000100:00100000:0.0:1788841832.828122:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788841832.828129:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:7624:x1875736500650112:12345-0@lo:502: 00000100:00100000:0.0:1788841832.828233:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:7624:x1875736500650112:12345-0@lo:502: Request processed in 104us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841832.828239:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788841832.828276:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500650112:0@lo:502: 00000040:00080000:0.0:1788841832.828363:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788841832.828372:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788841832.829115:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788841832.829126:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788841832.829134:0:7636:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788841832.829141:0:7636:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d3944ec2800 00000020:00000080:0.0:1788841832.829143:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788841832.829166:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788841832.829170:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788841832.829171:0:7636:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788841832.829174:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788841832.835094:0:7624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788841832.835137:0:7624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788841832.835159:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a82045a00/0x3de1064d33a8afde lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8afe5 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.835171:0:7624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a82045a00/0x3de1064d33a8afde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8afe5 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841832.835222:0:7624:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788841832.835225:0:7624:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d3944ec2800 10000000:01000000:1.0:1788841832.835228:0:7624:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d3944ec2800 10000000:01000000:1.0:1788841832.835232:0:7624:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788841832.835238:0:7624:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d3944ec2800 from 1 10000000:01000000:1.0:1788841832.835240:0:7624:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788841832.835276:0:7624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8afec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.835283:0:7624:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8afec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.835293:0:7624:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8afec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841832.835339:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500650240:0@lo:101: 00000100:00100000:1.0:1788841832.835418:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841832.835457:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e4e9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788841832.836378:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500650240 00000100:00100000:1.0:1788841832.836389:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500650240 00000100:00100000:1.0:1788841832.836444:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788841832.836453:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:7624:x1875736500650240:12345-0@lo:101: 00010000:00010000:1.0:1788841832.836467:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841832.836482:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a43531800/0x3de1064d33a8aff3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8afec expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.836506:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a43531800/0x3de1064d33a8aff3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8afec expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.836516:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a43531800/0x3de1064d33a8aff3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8afec expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.836525:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43531800, rc 0) 00000100:00100000:1.0:1788841832.836667:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:7624:x1875736500650240:12345-0@lo:101: Request processed in 215us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841832.836675:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788841832.836746:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500650240:0@lo:101: 00010000:00010000:1.0:1788841832.836762:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8afec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8aff3 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.836772:0:7624:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8afec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8aff3 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841832.838251:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500650368:0@lo:501: 00000100:00100000:1.0:1788841832.838329:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841832.838361:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e4e9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788841832.838390:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500650368 00000100:00100000:1.0:1788841832.838396:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500650368 00000100:00100000:1.0:1788841832.838437:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788841832.838445:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:7624:x1875736500650368:12345-0@lo:501: 00000100:00100000:1.0:1788841832.839269:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:7624:x1875736500650368:12345-0@lo:501: Request processed in 821us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841832.839279:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788841832.839439:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500650368:0@lo:501: 00000100:00100000:2.0:1788841832.839479:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b778700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500650496:0@lo:503: 00000100:00100000:2.0:1788841832.839525:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841832.839610:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a461e0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788841832.841687:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500650496 00000100:00100000:3.0:1788841832.841700:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500650496 00000100:00100000:3.0:1788841832.841952:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788841832.841963:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:7624:x1875736500650496:12345-0@lo:503: 00000100:00100000:3.0:1788841832.842217:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:7624:x1875736500650496:12345-0@lo:503: Request processed in 255us (2690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841832.842225:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788841832.842322:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b778700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500650496:0@lo:503: 00000040:00080000:2.0:1788841832.842613:0:7624:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788841832.842679:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b778700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500650624:0@lo:502: 00000100:00100000:2.0:1788841832.842748:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841832.850821:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a461e0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788841832.854443:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500650624 00000100:00100000:1.0:1788841832.854460:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500650624 00000100:00100000:1.0:1788841832.854529:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788841832.854540:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:7624:x1875736500650624:12345-0@lo:502: 00000100:00100000:1.0:1788841832.854905:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:7624:x1875736500650624:12345-0@lo:502: Request processed in 366us (12155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841832.854913:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788841832.855192:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b778700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500650624:0@lo:502: 00000040:00080000:2.0:1788841832.855547:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788841832.855634:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788841832.855672:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788841832.855743:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788841832.855784:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788841832.855834:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788841832.855889:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788841832.855926:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788841832.855979:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788841832.856016:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788841832.856053:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788841832.856104:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788841832.856139:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788841832.856186:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788841832.856232:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788841832.856267:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788841832.856294:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788841832.856364:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788841832.856401:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788841832.856433:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788841832.856476:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788841832.856507:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788841832.856538:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788841832.856598:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788841832.856639:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788841832.856673:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788841832.856754:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788841832.856791:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1788841832.856826:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788841832.856877:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1788841832.856913:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1788841832.856948:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1788841832.856984:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1788841832.857050:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1788841832.857083:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1788841832.857124:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1788841832.857155:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1788841832.857204:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b778700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500650752:0@lo:502: 00000100:00100000:2.0:1788841832.857281:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841832.857330:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a461e0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788841832.857902:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500650752 00000100:00100000:1.0:1788841832.857911:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500650752 00000100:00100000:1.0:1788841832.857955:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788841832.857964:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:7624:x1875736500650752:12345-0@lo:502: 00000100:00100000:1.0:1788841832.858203:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:7624:x1875736500650752:12345-0@lo:502: Request processed in 239us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841832.858210:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788841832.858271:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b778700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500650752:0@lo:502: 00000040:00080000:1.0:1788841832.858389:0:7624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1788841832.858401:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788841832.864189:0:7637:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788841832.864209:0:7637:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d3a4e558000) 00000020:00000080:1.0:1788841832.864237:0:7637:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1788841832.864324:0:7637:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d3944ec2800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788841832.864329:0:7637:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d3944ec2800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788841832.864332:0:7637:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d3944ec2800 3 00010000:00080000:1.0:1788841832.864365:0:7637:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d3a434a6800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.155@tcp at head 00010000:00010000:1.0:1788841832.870396:0:7637:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1788841832.870785:0:7637:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788841832.870832:0:7637:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788841832.870850:0:7637:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x3de1064d33a8b001 00000100:00080000:1.0:1788841832.870862:0:7637:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788841832.870868:0:7637:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d3a434a6800 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:1.0:1788841832.870909:0:7637:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3a4e0b6a00 x1875736500650880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788841832.870937:0:7637:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788841832.871197:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875736500650880:0@lo:38: 00000100:00100000:0.0:1788841832.871285:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841832.872012:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788841832.872027:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500651008:0@lo:400: 00000100:00100000:3.0:1788841832.872065:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841832.872099:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500651136:0@lo:400: 00000100:00100000:3.0:1788841832.872122:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841832.872138:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788841832.872143:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500651264:0@lo:400: 00000100:00100000:3.0:1788841832.872167:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841832.872201:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500650880 00000100:00100000:3.0:1788841832.872208:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500650880 00000100:00100000:3.0:1788841832.872233:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500651008 00000100:00100000:3.0:1788841832.872236:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500651008 00000100:00100000:3.0:1788841832.872265:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500651136 00000100:00100000:3.0:1788841832.872268:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500651136 00000100:00100000:3.0:1788841832.872285:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788841832.872293:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500651008:12345-0@lo:400: 00000100:00100000:3.0:1788841832.872362:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500651008:12345-0@lo:400: Request processed in 69us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841832.872370:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788841832.872387:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788841832.872393:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500651136:12345-0@lo:400: 00000100:00100000:3.0:1788841832.872424:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500651136:12345-0@lo:400: Request processed in 31us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841832.872430:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788841832.872442:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788841832.872446:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3306:x1875736500650880:12345-0@lo:38: 00010000:00080000:3.0:1788841832.872466:0:5851:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:3.0:1788841832.872494:0:5851:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3de1064d33a8b008 00000004:00100000:3.0:1788841832.872512:0:5851:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788841832.872544:0:5851:0:(import.c:65:import_set_state_nolock()) ffff8d3a7c0bb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788841832.872591:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875736500650880:12345-0@lo:38: Request processed in 130us (1292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841832.872597:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788841832.872615:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500651264 00000100:00100000:3.0:1788841832.872618:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500651264 00000100:00100000:3.0:1788841832.872642:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788841832.872648:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500651264:12345-0@lo:400: 00000100:00100000:3.0:1788841832.872676:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500651264:12345-0@lo:400: Request processed in 28us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841832.872690:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788841832.872754:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a76a83800 x1875736500651008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841832.872769:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500651008:0@lo:400: 00010000:00080000:3.0:1788841832.872799:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a76a80e00 x1875736500651264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841832.872808:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500651264:0@lo:400: 00010000:00080000:3.0:1788841832.872818:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a76a81180 x1875736500651136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841832.872826:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500651136:0@lo:400: 00010000:00080000:0.0:1788841832.872948:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a4e0b6a00 x1875736500650880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788841842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841832.872958:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788841832.872965:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788841832.872974:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788841832.872980:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788841832.872982:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8d3a434a6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788841832.872988:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875736500650880:0@lo:38: 00000040:00080000:1.0:1788841832.873327:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1788841832.873534:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed0000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7638:1875736500651392:0@lo:901: 00000100:00100000:0.0:1788841832.873588:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841832.873619:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a492ef780 going to sleep for 11 seconds 00000100:00100000:1.0:1788841832.873746:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500651392 00000100:00100000:1.0:1788841832.873752:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500651392 00000100:00100000:1.0:1788841832.873796:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788841832.873804:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7638:x1875736500651392:12345-0@lo:901: 00000100:00100000:1.0:1788841832.874154:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7638:x1875736500651392:12345-0@lo:901: Request processed in 350us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841832.874162:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788841832.874230:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788841832.874252:0:7638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a75ed0000 x1875736500651392/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788841848 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841832.874264:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed0000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7638:1875736500651392:0@lo:901: 00000020:01000000:3.0:1788841832.875704:0:7624:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788841832.875811:0:7624:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788841832.875833:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8afec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8aff3 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841832.875844:0:7624:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8afec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8aff3 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788841832.875895:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788841832.875898:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788841832.875899:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788841832.875900:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788841832.875901:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788841832.875902:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788841832.875904:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788841832.875905:0:7624:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788841832.875907:0:7624:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788841832.875908:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788841832.875914:0:7624:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788841832.875918:0:7624:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788841832.875920:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788841832.875921:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788841832.875922:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788841832.875923:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788841832.875924:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788841832.875925:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788841832.875926:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788841832.875926:0:7624:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788841832.875927:0:7624:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788841832.875928:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788841832.875929:0:7624:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788841832.875954:0:7624:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788841832.875972:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500651520:0@lo:253: 00000100:00100000:3.0:1788841832.876036:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841832.876124:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4ea5a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788841832.882471:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500651520 00000100:00100000:0.0:1788841832.882485:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500651520 00000100:00100000:0.0:1788841832.882541:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788841832.882557:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:7624:x1875736500651520:12345-0@lo:253: 20000000:01000000:0.0:1788841832.882644:0:5845:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788841832.882660:0:5845:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788841832.946159:0:5845:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788841832.946182:0:5845:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788841832.946228:0:5866:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788841832.946234:0:5866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788841832.946258:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d3a82044200/0x3de1064d33a8b00f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841832.946320:0:5866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8af60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8af59 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841832.946329:0:5866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d3a82044200/0x3de1064d33a8b00f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841832.946375:0:5866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8af60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8af59 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841832.946390:0:5866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8af60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8af59 expref: 14 pid: 5844 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841832.946406:0:5866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b778700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1875736500651648:0@lo:104: 00000100:00100000:2.0:1788841832.946471:0:5866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841832.946521:0:5866:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3944e29780 going to sleep for 11 seconds 00000100:00100000:3.0:1788841832.947056:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500651648 00000100:00100000:3.0:1788841832.947065:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500651648 00000100:00100000:3.0:1788841832.947122:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788841832.947133:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b77aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+3:5866:x1875736500651648:12345-0@lo:104: 00010000:00010000:3.0:1788841832.947147:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a40031000/0x3de1064d33a8af59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8af60 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841832.947397:0:5866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b778700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1875736500651648:0@lo:104: 00010000:00010000:2.0:1788841832.947420:0:5866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d3a82044200/0x3de1064d33a8b00f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841832.949894:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788841832.949914:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b77aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+3:5866:x1875736500651648:12345-0@lo:104: Request processed in 2778us (3436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841832.949926:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788841832.953915:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788841832.953935:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a40031000/0x3de1064d33a8af59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8af60 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.953946:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40031000 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:0.0:1788841832.953961:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a40031000/0x3de1064d33a8af59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8af60 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.953973:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a40031000/0x3de1064d33a8af59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8af60 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788841832.953985:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a40031000/0x3de1064d33a8af59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8af60 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841832.953990:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788841832.956103:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a40031000/0x3de1064d33a8af59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8af60 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.956138:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788841832.956171:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a40031000/0x3de1064d33a8af59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8af60 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.956179:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a40031000/0x3de1064d33a8af59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8af60 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.956204:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841832.956206:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841832.956208:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841832.956337:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788841832.956363:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500651776:0@lo:103: 00000100:00100000:0.0:1788841832.956441:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841832.956578:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500651776 00000100:00100000:1.0:1788841832.956585:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500651776 00010000:00010000:1.0:1788841832.956614:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8af60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8af59 expref: 15 pid: 5844 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841832.956649:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788841832.956658:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4ec1b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:3310:x1875736500651776:12345-0@lo:103: 00010000:00010000:1.0:1788841832.956669:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841832.956674:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8af60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8af59 expref: 15 pid: 5844 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.956685:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8af60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8af59 expref: 15 pid: 5844 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.956699:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8af60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8af59 expref: 15 pid: 5844 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.956767:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d3a82044200/0x3de1064d33a8b00f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.956787:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a82044200/0x3de1064d33a8b00f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788841832.956804:0:5835:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010570043s 00010000:00010000:1.0:1788841832.956809:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3a82044200/0x3de1064d33a8b00f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.956815:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3a82044200/0x3de1064d33a8b00f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.956823:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d3a82044200/0x3de1064d33a8b00f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.956829:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d3a82044200/0x3de1064d33a8b00f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.956834:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a82044200 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788841832.956838:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d3a82044200/0x3de1064d33a8b00f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.956856:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d3a82044200/0x3de1064d33a8b00f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.956876:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d3a82044200/0x3de1064d33a8b00f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841832.956887:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841832.956923:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4ec1b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:3310:x1875736500651776:12345-0@lo:103: Request processed in 267us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841832.956930:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788841832.957400:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500651776:0@lo:103: 00010000:00010000:0.0:1788841832.957428:0:5866:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d3a82044200/0x3de1064d33a8b00f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.957437:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d3a82044200/0x3de1064d33a8b00f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841832.957443:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a82044200/0x3de1064d33a8b00f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841832.975842:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:7624:x1875736500651520:12345-0@lo:253: Request processed in 93269us (99788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841832.975874:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788841832.976048:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd738bcb-4fee-4a21-af92-bab36d5458e2:7624:1875736500651520:0@lo:253: 10000000:01000000:3.0:1788841832.976066:0:7624:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788841832.976080:0:7624:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788841832.976081:0:7624:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788841832.976083:0:7624:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788841832.976084:0:7624:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788841832.976085:0:7624:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788841832.976086:0:7624:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788841832.976088:0:7624:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788841832.976089:0:7624:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788841832.976091:0:7624:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788841832.976092:0:7624:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788841832.976093:0:7624:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788841832.976108:0:7624:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788841832.987066:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788841832.987293:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788841832.987516:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788841832.989455:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788841832.989820:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788841832.991871:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788841832.994927:0:7624:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788841833.187659:0:7624:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788841833.187668:0:7624:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788841833.187700:0:7624:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788841833.187775:0:7624:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.155@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788841833.187792:0:7624:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788841833.187822:0:7624:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788841833.345787:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841834.370777:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841835.394348:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841836.417888:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841837.188115:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788841837.188142:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b778700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500651904:0@lo:13: 00000100:00100000:2.0:1788841837.188228:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841837.188346:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500651904 00000100:00100000:3.0:1788841837.188354:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500651904 00000100:00100000:3.0:1788841837.188414:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788841837.188424:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500651904:12345-0@lo:13: 00002000:00000024:3.0:1788841837.188457:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788841837.188515:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500651904:12345-0@lo:13: Request processed in 92us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841837.188523:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788841837.189992:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788841837.190047:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7b778700 x1875736500651904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841837.190071:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b778700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500651904:0@lo:13: 00010000:00010000:1.0:1788841837.441872:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841838.213295:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500652032:0@lo:400: 00000100:00100000:3.0:1788841838.213374:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841838.213426:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875736500652544:0@lo:400: 00000100:00100000:3.0:1788841838.213456:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841838.213550:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788841838.213557:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500652160:0@lo:400: 00000100:00100000:3.0:1788841838.213581:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841838.213609:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500652416:0@lo:400: 00000100:00100000:3.0:1788841838.213636:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841838.213654:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788841838.213674:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875736500652288:0@lo:400: 00000100:00100000:3.0:1788841838.213700:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841838.213755:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500652032 00000100:00100000:3.0:1788841838.213762:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500652032 00000100:00100000:3.0:1788841838.213885:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788841838.213894:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:3307:x1875736500652032:12345-0@lo:400: 00000100:00100000:3.0:1788841838.213943:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:3307:x1875736500652032:12345-0@lo:400: Request processed in 49us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841838.213949:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788841838.213991:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500652544 00000100:00100000:3.0:1788841838.213994:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500652544 00000100:00100000:3.0:1788841838.214027:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500652160 00000100:00100000:3.0:1788841838.214030:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500652160 00000100:00100000:3.0:1788841838.214041:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500652288 00000100:00100000:3.0:1788841838.214043:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500652288 00000100:00100000:3.0:1788841838.214057:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788841838.214062:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875736500652544:12345-0@lo:400: 00000100:00100000:3.0:1788841838.214092:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875736500652544:12345-0@lo:400: Request processed in 30us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841838.214098:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788841838.214112:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788841838.214118:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500652160:12345-0@lo:400: 00000100:00100000:3.0:1788841838.214144:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500652160:12345-0@lo:400: Request processed in 26us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841838.214150:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788841838.214162:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788841838.214167:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875736500652288:12345-0@lo:400: 00000100:00100000:3.0:1788841838.214195:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875736500652288:12345-0@lo:400: Request processed in 28us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841838.214218:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788841838.214248:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500652416 00000100:00100000:3.0:1788841838.214252:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500652416 00000100:00100000:3.0:1788841838.214273:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788841838.214279:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500652416:12345-0@lo:400: 00000100:00100000:3.0:1788841838.214308:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500652416:12345-0@lo:400: Request processed in 30us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841838.214314:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788841838.214355:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76a80e00 x1875736500652160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841838.214368:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500652160:0@lo:400: 00000100:00100000:3.0:1788841838.214378:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500652032:0@lo:400: 00010000:00080000:3.0:1788841838.214387:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76a80700 x1875736500652544/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841838.214394:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875736500652544:0@lo:400: 00010000:00080000:3.0:1788841838.214429:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76a83800 x1875736500652288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841838.214437:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875736500652288:0@lo:400: 00010000:00080000:3.0:1788841838.214446:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76a83100 x1875736500652416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841838.214453:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500652416:0@lo:400: 00000100:00080000:2.0:1788841838.215638:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788841838.467798:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841839.489861:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788841839.747399:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788841839.747407:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d3a4e19d800 from 30 10000000:01000000:1.0:1788841839.747413:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788841839.747469:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b016 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841839.747483:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b016 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841839.747493:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b016 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841839.747520:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500652672:0@lo:101: 00000100:00100000:1.0:1788841839.747595:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841839.747933:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e9b0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788841839.748096:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500652672 00000100:00100000:2.0:1788841839.748105:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500652672 00000100:00100000:2.0:1788841839.748206:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788841839.748218:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:5847:x1875736500652672:12345-0@lo:101: 00010000:00010000:2.0:1788841839.748245:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841839.748261:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a82045400/0x3de1064d33a8b01d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8b016 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841839.748286:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a82045400/0x3de1064d33a8b01d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8b016 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841839.748307:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a82045400/0x3de1064d33a8b01d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b016 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841839.748316:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a82045400, rc 0) 00000100:00100000:2.0:1788841839.748371:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:5847:x1875736500652672:12345-0@lo:101: Request processed in 156us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841839.748382:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788841839.748464:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500652672:0@lo:101: 00010000:00010000:1.0:1788841839.748490:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b016 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b01d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841839.748499:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b016 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b01d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841839.748557:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500652800:0@lo:501: 00000100:00100000:1.0:1788841839.748584:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841839.749126:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500652800 00000100:00100000:3.0:1788841839.749138:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500652800 00000100:00100000:1.0:1788841839.749146:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e9b0600 going to sleep for 11 seconds 00000100:00100000:3.0:1788841839.749164:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788841839.749185:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:5847:x1875736500652800:12345-0@lo:501: 00000100:00100000:3.0:1788841839.749636:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:5847:x1875736500652800:12345-0@lo:501: Request processed in 464us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841839.749644:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788841839.749695:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500652800:0@lo:501: 00000100:00100000:1.0:1788841839.749766:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500652928:0@lo:503: 00000100:00100000:1.0:1788841839.749806:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841839.749822:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e9b0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788841839.749947:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500652928 00000100:00100000:2.0:1788841839.749953:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500652928 00000100:00100000:2.0:1788841839.750020:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788841839.750029:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:5847:x1875736500652928:12345-0@lo:503: 00000100:00100000:2.0:1788841839.750532:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:5847:x1875736500652928:12345-0@lo:503: Request processed in 504us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841839.750541:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788841839.750656:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500652928:0@lo:503: 00000100:00100000:2.0:1788841839.751215:0:7977:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b778700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:7977:1875736500653056:0@lo:502: 00000100:00100000:2.0:1788841839.751408:0:7977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841839.751531:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500653056 00000100:00100000:3.0:1788841839.751537:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500653056 00000100:00100000:3.0:1788841839.751606:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788841839.751615:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:7977:x1875736500653056:12345-0@lo:502: 00000100:00100000:3.0:1788841839.751936:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:7977:x1875736500653056:12345-0@lo:502: Request processed in 321us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841839.751945:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788841839.752035:0:7977:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a463a4900 going to sleep for 11 seconds 00000100:00100000:2.0:1788841839.752054:0:7977:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b778700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:7977:1875736500653056:0@lo:502: 00000100:00100000:2.0:1788841839.752107:0:7977:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b778700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:7977:1875736500653184:0@lo:502: 00000100:00100000:2.0:1788841839.752154:0:7977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841839.752471:0:7977:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a612b5300 going to sleep for 11 seconds 00000100:00100000:1.0:1788841839.754386:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500653184 00000100:00100000:1.0:1788841839.754400:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500653184 00000100:00100000:1.0:1788841839.754511:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788841839.754523:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:7977:x1875736500653184:12345-0@lo:502: 00000100:00100000:1.0:1788841839.754981:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:7977:x1875736500653184:12345-0@lo:502: Request processed in 460us (2837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841839.754989:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788841839.762048:0:7977:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b778700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:7977:1875736500653184:0@lo:502: 00000040:00080000:2.0:1788841839.762094:0:7977:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788841839.762219:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788841839.762248:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788841839.762260:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b016 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b01d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841839.762272:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b01d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841839.762282:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788841839.762284:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788841839.762287:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788841839.762332:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43530600/0x3de1064d33a8b024 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841839.762340:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a43530600/0x3de1064d33a8b024 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841839.762350:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a43530600/0x3de1064d33a8b024 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841839.762382:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500653312:0@lo:101: 00000100:00100000:1.0:1788841839.762458:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841839.762497:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e9b0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788841839.762516:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500653312 00000100:00100000:1.0:1788841839.762522:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500653312 00000100:00100000:1.0:1788841839.762563:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788841839.762573:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:5847:x1875736500653312:12345-0@lo:101: 00010000:00010000:1.0:1788841839.762586:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841839.762599:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a43530a00/0x3de1064d33a8b02b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8b024 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841839.762622:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a43530a00/0x3de1064d33a8b02b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8b024 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841839.762632:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a43530a00/0x3de1064d33a8b02b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b024 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841839.762640:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43530a00, rc 0) 00000100:00100000:1.0:1788841839.762674:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:5847:x1875736500653312:12345-0@lo:101: Request processed in 102us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841839.762680:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788841839.762739:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500653312:0@lo:101: 00010000:00010000:1.0:1788841839.762750:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a43530600/0x3de1064d33a8b024 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b02b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841839.762760:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a43530600/0x3de1064d33a8b024 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b02b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841839.762810:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500653440:0@lo:501: 00000100:00100000:1.0:1788841839.762833:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841839.762849:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e9b0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788841839.762864:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500653440 00000100:00100000:1.0:1788841839.762867:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500653440 00000100:00100000:1.0:1788841839.762888:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788841839.762894:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:5847:x1875736500653440:12345-0@lo:501: 00000100:00100000:1.0:1788841839.763168:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:5847:x1875736500653440:12345-0@lo:501: Request processed in 272us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841839.763184:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788841839.763469:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500653440:0@lo:501: 00000100:00100000:0.0:1788841839.763503:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500653568:0@lo:503: 00000100:00100000:0.0:1788841839.763543:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841839.763578:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a465d0180 going to sleep for 11 seconds 00000100:00100000:1.0:1788841839.764025:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500653568 00000100:00100000:1.0:1788841839.764032:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500653568 00000100:00100000:1.0:1788841839.764066:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788841839.764074:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:5847:x1875736500653568:12345-0@lo:503: 00000100:00100000:1.0:1788841839.764559:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:5847:x1875736500653568:12345-0@lo:503: Request processed in 484us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841839.764568:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788841839.764619:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500653568:0@lo:503: 00000100:00100000:1.0:1788841839.764816:0:7978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:7978:1875736500653696:0@lo:502: 00000100:00100000:1.0:1788841839.764855:0:7978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841839.764876:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500653696 00000100:00100000:1.0:1788841839.764880:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500653696 00000100:00100000:1.0:1788841839.764906:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788841839.764913:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:7978:x1875736500653696:12345-0@lo:502: 00000100:00100000:1.0:1788841839.765067:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:7978:x1875736500653696:12345-0@lo:502: Request processed in 153us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841839.765081:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788841839.765120:0:7978:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a465d0180 going to sleep for 11 seconds 00000100:00100000:1.0:1788841839.765133:0:7978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:7978:1875736500653696:0@lo:502: 00000020:01000000:1.0:1788841839.765154:0:7978:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788841839.765162:0:7978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841839.765164:0:7978:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788841839.765180:0:7978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788841839.765183:0:7978:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788841839.765197:0:7978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:7978:1875736500653824:0@lo:502: 00000100:00100000:1.0:1788841839.765240:0:7978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841839.765258:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500653824 00000100:00100000:1.0:1788841839.765262:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500653824 00000100:00100000:1.0:1788841839.765281:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788841839.765286:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:7978:x1875736500653824:12345-0@lo:502: 00000100:00100000:0.0:1788841839.765775:0:7978:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a500c09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788841839.766011:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:7978:x1875736500653824:12345-0@lo:502: Request processed in 722us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841839.766019:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788841839.769397:0:7978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:7978:1875736500653824:0@lo:502: 00000020:01000000:0.0:1788841839.769442:0:7978:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788841839.769449:0:7978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788841839.769452:0:7978:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788841839.769457:0:7978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788841839.769758:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788841839.769784:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788841839.769797:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43530600/0x3de1064d33a8b024 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b02b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841839.769809:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a43530600/0x3de1064d33a8b024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b02b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841839.769821:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788841839.769823:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d3a43e8f800 from 30 10000000:01000000:1.0:1788841839.769826:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788841839.769867:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43530400/0x3de1064d33a8b032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841839.769876:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a43530400/0x3de1064d33a8b032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841839.769886:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a43530400/0x3de1064d33a8b032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841839.769909:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500653952:0@lo:101: 00000100:00100000:1.0:1788841839.769989:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841839.770028:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a500c03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841839.779438:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500653952 00000100:00100000:0.0:1788841839.779462:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500653952 00000100:00100000:0.0:1788841839.782219:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788841839.782252:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:5847:x1875736500653952:12345-0@lo:101: 00010000:00010000:0.0:1788841839.782273:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841839.782292:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a40031000/0x3de1064d33a8b039 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8b032 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841839.782320:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a40031000/0x3de1064d33a8b039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8b032 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841839.782331:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a40031000/0x3de1064d33a8b039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b032 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841839.782341:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40031000, rc 0) 00000100:00100000:0.0:1788841839.782423:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:5847:x1875736500653952:12345-0@lo:101: Request processed in 185us (12433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841839.782429:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788841839.782490:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500653952:0@lo:101: 00010000:00010000:0.0:1788841839.782509:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a43530400/0x3de1064d33a8b032 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b039 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841839.782519:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a43530400/0x3de1064d33a8b032 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b039 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841839.783279:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500654080:0@lo:501: 00000100:00100000:0.0:1788841839.783318:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841839.783362:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a61941e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788841839.783369:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500654080 00000100:00100000:1.0:1788841839.783378:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500654080 00000100:00100000:1.0:1788841839.783425:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788841839.783433:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:5847:x1875736500654080:12345-0@lo:501: 00000100:00100000:1.0:1788841839.783845:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:5847:x1875736500654080:12345-0@lo:501: Request processed in 412us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841839.783853:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788841839.784577:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500654080:0@lo:501: 00000100:00100000:0.0:1788841839.784632:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500654208:0@lo:503: 00000100:00100000:0.0:1788841839.784684:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841839.785240:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a61941e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788841839.785359:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500654208 00000100:00100000:1.0:1788841839.785367:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500654208 00000100:00100000:1.0:1788841839.785410:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788841839.785418:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:5847:x1875736500654208:12345-0@lo:503: 00000100:00100000:1.0:1788841839.785623:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:5847:x1875736500654208:12345-0@lo:503: Request processed in 204us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841839.785630:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788841839.789824:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500654208:0@lo:503: 00000100:00100000:0.0:1788841839.790619:0:7983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:7983:1875736500654336:0@lo:502: 00000100:00100000:0.0:1788841839.790919:0:7983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841839.790969:0:7983:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a48711f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788841839.791933:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500654336 00000100:00100000:1.0:1788841839.791955:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500654336 00000100:00100000:1.0:1788841839.792012:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788841839.792022:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:7983:x1875736500654336:12345-0@lo:502: 00000100:00100000:1.0:1788841839.793803:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:7983:x1875736500654336:12345-0@lo:502: Request processed in 1775us (3088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841839.793817:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788841839.794024:0:7983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:7983:1875736500654336:0@lo:502: 00000100:00100000:0.0:1788841839.794098:0:7983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:7983:1875736500654464:0@lo:502: 00000100:00100000:0.0:1788841839.794141:0:7983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841839.794757:0:7983:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c2900 going to sleep for 11 seconds 00000100:00100000:1.0:1788841839.794855:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500654464 00000100:00100000:1.0:1788841839.794864:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500654464 00000100:00100000:1.0:1788841839.794956:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788841839.794966:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:7983:x1875736500654464:12345-0@lo:502: 00000100:00100000:1.0:1788841839.795423:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:7983:x1875736500654464:12345-0@lo:502: Request processed in 457us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841839.795432:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788841839.795652:0:7983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:7983:1875736500654464:0@lo:502: 00000040:00080000:0.0:1788841839.795684:0:7983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788841839.795865:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788841839.795966:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788841839.795977:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43530400/0x3de1064d33a8b032 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b039 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841839.796074:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a43530400/0x3de1064d33a8b032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b039 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841839.796086:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788841839.796089:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d3a43e8f800 from 5 10000000:01000000:1.0:1788841839.796092:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788841839.796125:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43531600/0x3de1064d33a8b040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841839.796134:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a43531600/0x3de1064d33a8b040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841839.796373:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a43531600/0x3de1064d33a8b040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841839.796396:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500654592:0@lo:101: 00000100:00100000:1.0:1788841839.796458:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841839.796502:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a61941e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788841839.796579:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500654592 00000100:00100000:0.0:1788841839.796586:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500654592 00000100:00100000:0.0:1788841839.796632:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788841839.796643:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:5847:x1875736500654592:12345-0@lo:101: 00010000:00010000:0.0:1788841839.796656:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841839.796672:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a40031600/0x3de1064d33a8b047 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8b040 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841839.796699:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a40031600/0x3de1064d33a8b047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8b040 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841839.796870:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a40031600/0x3de1064d33a8b047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b040 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841839.796883:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40031600, rc 0) 00000100:00100000:0.0:1788841839.796986:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:5847:x1875736500654592:12345-0@lo:101: Request processed in 345us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841839.796994:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788841839.797060:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500654592:0@lo:101: 00010000:00010000:1.0:1788841839.797075:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a43531600/0x3de1064d33a8b040 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b047 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841839.797085:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a43531600/0x3de1064d33a8b040 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b047 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841839.797138:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500654720:0@lo:256: 00000100:00100000:1.0:1788841839.797184:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841839.797246:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a61941e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788841839.797400:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500654720 00000100:00100000:0.0:1788841839.797405:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500654720 00000100:00100000:0.0:1788841839.797611:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788841839.797620:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:5847:x1875736500654720:12345-0@lo:256: 20000000:01000000:0.0:1788841839.797636:0:5842:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788841839.797654:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788841839.797657:0:5842:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788841839.797824:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:5847:x1875736500654720:12345-0@lo:256: Request processed in 205us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841839.797831:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788841839.797910:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500654720:0@lo:256: 10000000:01000000:1.0:1788841839.797960:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788841839.797968:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43531600/0x3de1064d33a8b040 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b047 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841839.797979:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a43531600/0x3de1064d33a8b040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b047 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841839.797988:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788841839.797991:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788841839.798000:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788841839.798024:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43530c00/0x3de1064d33a8b04e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841839.798032:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a43530c00/0x3de1064d33a8b04e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841839.798041:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a43530c00/0x3de1064d33a8b04e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841839.798056:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500654848:0@lo:101: 00000100:00100000:1.0:1788841839.798082:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841839.798258:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a6193a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788841839.798427:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500654848 00000100:00100000:3.0:1788841839.798433:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500654848 00000100:00100000:3.0:1788841839.798645:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788841839.798655:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:5847:x1875736500654848:12345-0@lo:101: 00010000:00010000:3.0:1788841839.798665:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841839.798677:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a60053400/0x3de1064d33a8b055 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8b04e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841839.798699:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a60053400/0x3de1064d33a8b055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8b04e expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841839.798734:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a60053400/0x3de1064d33a8b055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b04e expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841839.798754:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60053400, rc 0) 00000100:00100000:3.0:1788841839.800642:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500654848:12345-0@lo:101: Request processed in 1980us (2550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841839.800656:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788841839.802435:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500654848:0@lo:101: 00010000:00010000:1.0:1788841839.802863:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a43530c00/0x3de1064d33a8b04e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b055 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841839.802877:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a43530c00/0x3de1064d33a8b04e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b055 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841839.802962:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500654976:0@lo:501: 00000100:00100000:1.0:1788841839.803024:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841839.803074:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a6193a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788841839.803879:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500654976 00000100:00100000:0.0:1788841839.803889:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500654976 00000100:00100000:0.0:1788841839.803945:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788841839.803955:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49926050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500654976:12345-0@lo:501: 00000100:00100000:0.0:1788841839.804834:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49926050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500654976:12345-0@lo:501: Request processed in 878us (1806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841839.804844:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788841839.804948:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500654976:0@lo:501: 00000100:00100000:1.0:1788841839.804997:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500655104:0@lo:503: 00000100:00100000:1.0:1788841839.805052:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841839.805136:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a6193a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788841839.805221:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500655104 00000100:00100000:3.0:1788841839.805294:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500655104 00000100:00100000:3.0:1788841839.805371:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788841839.805380:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500655104:12345-0@lo:503: 00000100:00100000:3.0:1788841839.805789:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500655104:12345-0@lo:503: Request processed in 410us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841839.805798:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788841839.805912:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500655104:0@lo:503: 00000100:00100000:0.0:1788841839.806110:0:7984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:7984:1875736500655232:0@lo:502: 00000100:00100000:0.0:1788841839.806151:0:7984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841839.806785:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500655232 00000100:00100000:1.0:1788841839.806801:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500655232 00000100:00100000:1.0:1788841839.806830:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788841839.806837:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49924850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:7984:x1875736500655232:12345-0@lo:502: 00000100:00100000:1.0:1788841839.807107:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49924850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:7984:x1875736500655232:12345-0@lo:502: Request processed in 269us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841839.807114:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788841839.807375:0:7984:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c2180 going to sleep for 11 seconds 00000100:00100000:1.0:1788841839.807396:0:7984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:7984:1875736500655232:0@lo:502: 00000020:01000000:1.0:1788841839.807428:0:7984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788841839.807438:0:7984:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788841839.807457:0:7984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841839.807460:0:7984:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788841839.807466:0:7984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788841839.807471:0:7984:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.155@tcp to nid 0x20000c0a8cc9b (192.168.204.155@tcp) 00000020:01000000:1.0:1788841839.807511:0:7984:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788841839.807514:0:7984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788841839.807545:0:7984:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d39462e8000) 00000020:00000080:1.0:1788841839.807577:0:7984:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788841839.807584:0:7984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788841839.807670:0:7984:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788841839.807677:0:7984:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788841839.807685:0:7984:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3de1064d33a8b063 00010000:00080000:1.0:1788841839.807739:0:7984:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d3944ec1800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.155@tcp at head 00010000:00010000:1.0:1788841839.807967:0:7984:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788841839.808320:0:7984:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788841839.808335:0:7984:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788841839.808968:0:7984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788841839.809206:0:7984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788841839.809263:0:7984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788841839.809328:0:7984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788841839.813504:0:7985:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788841839.813529:0:7985:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788841839.818512:0:7984:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788841839.818531:0:7984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788841839.818572:0:7984:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788841839.818599:0:7984:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3de1064d33a8b06a 00000100:00080000:2.0:1788841839.818611:0:7984:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788841839.818618:0:7984:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d3944ec1800 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:2.0:1788841839.818654:0:7984:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3a7b778700 x1875736500655360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788841839.818683:0:7984:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788841839.818931:0:7984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788841839.818936:0:7984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788841839.818937:0:7984:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788841839.818942:0:7984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788841839.818946:0:7984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788841839.818947:0:7984:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788841839.818950:0:7984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788841839.818952:0:7984:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788841839.818983:0:7984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b779c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:7984:1875736500655616:0@lo:502: 00000100:00100000:2.0:1788841839.819080:0:7984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841839.819130:0:7984:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a61289d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788841839.819136:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875736500655488:0@lo:400: 00000100:00100000:1.0:1788841839.819187:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841839.819219:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788841839.819278:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500655488 00000100:00100000:2.0:1788841839.819291:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500655488 00000100:00100000:2.0:1788841839.819339:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788841839.819345:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b778700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875736500655360:0@lo:8: 00000100:00100000:2.0:1788841839.819353:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875736500655488:12345-0@lo:400: 00000100:00100000:0.0:1788841839.819389:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841839.819413:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875736500655488:12345-0@lo:400: Request processed in 63us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841839.819422:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788841839.819434:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500655360 00000100:00100000:0.0:1788841839.819439:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500655360 00000100:00100000:0.0:1788841839.819481:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788841839.819486:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3306:x1875736500655360:12345-0@lo:8: 00010000:00080000:0.0:1788841839.819507:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:0.0:1788841839.819537:0:6695:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3de1064d33a8b071 00002000:00100000:0.0:1788841839.819551:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d3a75ee5000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113972 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788841839.819555:0:6695:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1788841839.819558:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788841839.820140:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500656000:0@lo:400: 00000100:00100000:1.0:1788841839.820193:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788841839.820244:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a4e0b6a00 x1875736500655488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841839.820259:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875736500655488:0@lo:400: 00000100:00100000:1.0:1788841839.820291:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500655744:0@lo:400: 00000100:00100000:1.0:1788841839.820315:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841839.820336:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788841839.820342:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500655872:0@lo:400: 00000100:00100000:1.0:1788841839.820364:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841839.820394:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500655616 00000100:00100000:1.0:1788841839.820398:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500655616 00000100:00100000:1.0:1788841839.820439:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788841839.820446:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:7984:x1875736500655616:12345-0@lo:502: 00000100:00100000:1.0:1788841839.820682:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:7984:x1875736500655616:12345-0@lo:502: Request processed in 237us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841839.820689:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788841839.820751:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500656000 00000100:00100000:1.0:1788841839.820756:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500655744 00000100:00100000:2.0:1788841839.820757:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500656000 00000100:00100000:1.0:1788841839.820763:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500655744 00000100:00100000:2.0:1788841839.820797:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788841839.820806:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500656000:12345-0@lo:400: 00000100:00100000:2.0:1788841839.820852:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500656000:12345-0@lo:400: Request processed in 47us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841839.820859:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788841839.820872:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788841839.821014:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500655744:12345-0@lo:400: 00000100:00100000:2.0:1788841839.821051:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500655744:12345-0@lo:400: Request processed in 39us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841839.821056:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00002000:00100000:0.0:1788841839.821183:0:6695:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788841839.821360:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788841839.821387:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8d3a75ee7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788841839.821434:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1875736500655360:12345-0@lo:8: Request processed in 1947us (2045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841839.821442:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788841839.821456:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500655872 00000100:00100000:0.0:1788841839.821460:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500655872 00000100:00100000:0.0:1788841839.821493:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788841839.821501:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500655872:12345-0@lo:400: 00000100:00100000:0.0:1788841839.821531:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500655872:12345-0@lo:400: Request processed in 32us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841839.821537:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788841839.821573:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7b778700 x1875736500655360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788841849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841839.821584:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788841839.821591:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788841839.821599:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788841839.821605:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788841839.821607:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8d3944ec1800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788841839.821626:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788841839.821632:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b778700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875736500655360:0@lo:8: 00000100:00080000:0.0:1788841839.821651:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1788841839.822666:0:7982:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00080000:2.0:1788841839.827144:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a4e0b4380 x1875736500655872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841839.827165:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500655872:0@lo:400: 00010000:00080000:2.0:1788841839.827192:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a4e0b6d80 x1875736500655744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841839.827201:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500655744:0@lo:400: 00010000:00080000:2.0:1788841839.827263:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a4e0b4000 x1875736500656000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841839.827291:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500656000:0@lo:400: 00000004:00080000:2.0:1788841839.827314:0:7985:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788841839.827462:0:7985:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 167984751928ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788841839.827491:0:7984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b779c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:7984:1875736500655616:0@lo:502: 00000020:01000000:2.0:1788841839.827527:0:7984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788841839.827534:0:7984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788841839.827536:0:7984:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788841839.827542:0:7984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788841839.827643:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788841839.827674:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788841839.827686:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43530c00/0x3de1064d33a8b04e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b055 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841839.827697:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a43530c00/0x3de1064d33a8b04e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b055 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841839.827732:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788841839.827736:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d3a435699b8 from 1 10000000:01000000:0.0:1788841839.827740:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788841839.827778:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a40030c00/0x3de1064d33a8b078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841839.827787:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a40030c00/0x3de1064d33a8b078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841839.827797:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a40030c00/0x3de1064d33a8b078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841839.827819:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500656128:0@lo:101: 00000100:00100000:0.0:1788841839.827894:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841839.827943:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788841839.827963:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500656128 00000100:00100000:0.0:1788841839.827970:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500656128 00000100:00100000:0.0:1788841839.828034:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788841839.828044:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500656128:12345-0@lo:101: 00010000:00010000:0.0:1788841839.828068:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841839.828080:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a40031800/0x3de1064d33a8b07f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8b078 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841839.828104:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a40031800/0x3de1064d33a8b07f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8b078 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841839.828115:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a40031800/0x3de1064d33a8b07f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b078 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841839.828122:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40031800, rc 0) 00000100:00100000:0.0:1788841839.828161:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:5847:x1875736500656128:12345-0@lo:101: Request processed in 118us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841839.828180:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788841839.828229:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500656128:0@lo:101: 00010000:00010000:0.0:1788841839.828242:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a40030c00/0x3de1064d33a8b078 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b07f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841839.828251:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a40030c00/0x3de1064d33a8b078 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b07f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841839.828291:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500656256:0@lo:501: 00000100:00100000:0.0:1788841839.828315:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841839.828329:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788841839.828341:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500656256 00000100:00100000:0.0:1788841839.828344:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500656256 00000100:00100000:0.0:1788841839.828367:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788841839.828373:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49926c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:5847:x1875736500656256:12345-0@lo:501: 00000100:00100000:0.0:1788841839.830066:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49926c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:5847:x1875736500656256:12345-0@lo:501: Request processed in 1670us (1727us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788841839.830078:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788841839.830149:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500656256:0@lo:501: 10000000:01000000:0.0:1788841839.830346:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788841839.830357:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a40030c00/0x3de1064d33a8b078 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b07f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841839.830367:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a40030c00/0x3de1064d33a8b078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b07f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788841839.926691:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788841839.928816:0:7986:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788841839.928853:0:7986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b779880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7986:1875736500656512:0@lo:7: 00000100:00100000:2.0:1788841839.928936:0:7986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841839.928995:0:7986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a6120c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788841839.929019:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b779c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500656384:0@lo:13: 00000100:00100000:2.0:1788841839.929050:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841839.929093:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500656512 00000100:00100000:2.0:1788841839.929100:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500656512 00000100:00100000:2.0:1788841839.929179:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788841839.929188:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b77a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7986:x1875736500656512:12345-0@lo:7: 00000100:00080000:1.0:1788841839.932181:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788841839.935577:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500656384 00000100:00100000:3.0:1788841839.935593:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500656384 00002000:00080000:2.0:1788841839.935758:0:6695:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788841839.935764:0:6695:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788841839.935845:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788841839.935857:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875736500656384:12345-0@lo:13: 00002000:00000024:3.0:1788841839.935887:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788841839.939690:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875736500656384:12345-0@lo:13: Request processed in 3825us (10628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841839.939721:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788841839.940002:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7b779c00 x1875736500656384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841855 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841839.940025:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b779c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500656384:0@lo:13: 00000100:00100000:2.0:1788841839.941384:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b77a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7986:x1875736500656512:12345-0@lo:7: Request processed in 12189us (12441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841839.941398:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788841839.941493:0:7986:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7b779880 x1875736500656512/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788841855 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841839.941508:0:7986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b779880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7986:1875736500656512:0@lo:7: 00000004:00080000:2.0:1788841839.941534:0:7986:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788841839.941581:0:7986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b779880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7986:1875736500656640:0@lo:5: 00000100:00100000:2.0:1788841839.941657:0:7986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841839.941702:0:7986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a6120c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788841839.941761:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500656640 00000100:00100000:3.0:1788841839.941769:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500656640 00000100:00100000:0.0:1788841839.949730:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788841839.949757:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7986:x1875736500656640:12345-0@lo:5: 00002000:00080000:0.0:1788841839.949795:0:6695:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788841839.949800:0:6695:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788841839.950202:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7986:x1875736500656640:12345-0@lo:5: Request processed in 457us (8544us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788841839.950210:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788841839.950266:0:7986:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7b779880 x1875736500656640/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788841855 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841839.950285:0:7986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b779880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7986:1875736500656640:0@lo:5: 00000004:00080000:0.0:1788841839.950297:0:7986:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788841839.950350:0:7986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7986:1875736500656768:0@lo:700: 00000100:00100000:0.0:1788841839.950387:0:7986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841839.950424:0:7986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a43eb0240 going to sleep for 11 seconds 00000100:00100000:0.0:1788841839.951974:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500656768 00000100:00100000:0.0:1788841839.951988:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500656768 00000100:00100000:0.0:1788841839.952059:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788841839.952068:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7986:x1875736500656768:12345-0@lo:700: 00000100:00100000:0.0:1788841839.952119:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6702:1875736500656896:0@lo:700: 00000100:00100000:0.0:1788841839.952186:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841839.952212:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a454d7240 going to sleep for 11 seconds 00000100:00100000:0.0:1788841839.952240:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500656896 00000100:00100000:0.0:1788841839.952244:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500656896 00000100:00100000:0.0:1788841839.952273:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788841839.952280:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6702:x1875736500656896:12345-0@lo:700: 40000000:02000000:1.0:1788841840.002810:0:5857:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788841840.015883:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6702:x1875736500656896:12345-0@lo:700: Request processed in 63592us (63685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841840.015905:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788841840.016556:0:6702:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a75ed2d80 x1875736500656896/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788841855 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841840.016576:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6702:1875736500656896:0@lo:700: 40000000:02000000:3.0:1788841840.016603:0:6702:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1788841840.146198:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1788841840.146216:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788841840.149728:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7986:x1875736500656768:12345-0@lo:700: Request processed in 197628us (199306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841840.149744:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788841840.150854:0:7986:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a75ed1500 x1875736500656768/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788841855 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841840.150869:0:7986:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788841840.150891:0:7986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7986:1875736500656768:0@lo:700: 00000004:02000040:0.0:1788841840.238433:0:7986:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1788841840.249846:0:7986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7986:1875736500657024:0@lo:5: 00000100:00100000:1.0:1788841840.249932:0:7986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841840.249992:0:7986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a48d29480 going to sleep for 11 seconds 00000100:00100000:2.0:1788841840.250201:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500657024 00000100:00100000:2.0:1788841840.250210:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500657024 00000100:00100000:2.0:1788841840.250269:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788841840.250279:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7986:x1875736500657024:12345-0@lo:5: 00002000:00080000:3.0:1788841840.257075:0:6696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788841840.257096:0:6696:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788841840.271212:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7986:x1875736500657024:12345-0@lo:5: Request processed in 20924us (21270us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788841840.271228:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788841840.271487:0:7986:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a4e0b4a80 x1875736500657024/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788841856 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841840.271506:0:7986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7986:1875736500657024:0@lo:5: 00000004:00080000:1.0:1788841840.271522:0:7986:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1788841840.515278:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841841.537909:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841842.308973:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788841842.309001:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500657152:0@lo:13: 00000100:00100000:1.0:1788841842.309089:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841842.309324:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500657152 00000100:00100000:3.0:1788841842.309336:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500657152 00000100:00100000:3.0:1788841842.309481:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788841842.309499:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500657152:12345-0@lo:13: 00002000:00000024:3.0:1788841842.309538:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788841842.309606:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500657152:12345-0@lo:13: Request processed in 113us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841842.309615:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788841842.310085:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788841842.310139:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a4e0b5500 x1875736500657152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841842.310167:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500657152:0@lo:13: 00010000:00010000:1.0:1788841842.563169:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841843.586660:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841844.609835:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841844.869778:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875736500657536:0@lo:400: 00000100:00100000:1.0:1788841844.869788:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500657280:0@lo:400: 00000100:00100000:2.0:1788841844.869883:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500657664:0@lo:400: 00000100:00100000:1.0:1788841844.881445:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841844.881539:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875736500657792:0@lo:400: 00000100:00100000:1.0:1788841844.881584:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841844.881659:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500657792 00000100:00100000:1.0:1788841844.881670:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500657792 00000100:00100000:1.0:1788841844.881766:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788841844.881777:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875736500657792:12345-0@lo:400: 00000100:00100000:0.0:1788841844.881921:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500657280 00000100:00100000:0.0:1788841844.881927:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500657280 00000100:00100000:1.0:1788841844.881946:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875736500657792:12345-0@lo:400: Request processed in 170us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841844.881954:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788841844.881959:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788841844.881965:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3310:x1875736500657280:12345-0@lo:400: 00000100:00080000:1.0:1788841844.881979:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788841844.882003:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3310:x1875736500657280:12345-0@lo:400: Request processed in 38us (572us total) trans 0 rc 0/0 00010000:00080000:1.0:1788841844.882016:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76a80e00 x1875736500657792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841844.882016:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788841844.882031:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875736500657792:0@lo:400: 00000100:00100000:1.0:1788841844.882052:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500657280:0@lo:400: 00000100:00100000:1.0:1788841844.882527:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500657408:0@lo:400: 00000100:00100000:1.0:1788841844.882567:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841844.882604:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500657920:0@lo:400: 00000100:00100000:0.0:1788841844.882628:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500657408 00000100:00100000:1.0:1788841844.882633:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841844.882634:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500657408 00000100:00100000:1.0:1788841844.882674:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500657920 00000100:00100000:1.0:1788841844.882678:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500657920 00000100:00100000:1.0:1788841844.882742:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788841844.882751:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875736500657920:12345-0@lo:400: 00000100:00100000:0.0:1788841844.882751:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788841844.882759:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500657408:12345-0@lo:400: 00000100:00100000:1.0:1788841844.882798:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875736500657920:12345-0@lo:400: Request processed in 48us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841844.882798:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500657408:12345-0@lo:400: Request processed in 39us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841844.882804:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788841844.883151:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788841844.883173:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788841844.883202:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76a83800 x1875736500657408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841844.883214:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500657408:0@lo:400: 00010000:00080000:1.0:1788841844.883240:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76a83b80 x1875736500657920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841844.883270:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500657920:0@lo:400: 00000100:00100000:3.0:1788841844.883492:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841844.883556:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841844.883915:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500657536 00000100:00100000:1.0:1788841844.883922:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500657536 00000100:00100000:1.0:1788841844.883973:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788841844.883982:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875736500657536:12345-0@lo:400: 00000100:00100000:1.0:1788841844.884038:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875736500657536:12345-0@lo:400: Request processed in 57us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841844.884046:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788841844.884064:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788841844.884338:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500657664 00000100:00100000:0.0:1788841844.884344:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500657664 00000100:00100000:0.0:1788841844.884382:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788841844.884392:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500657664:12345-0@lo:400: 00010000:00080000:3.0:1788841844.884427:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76a80700 x1875736500657536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841844.884443:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875736500657536:0@lo:400: 00000100:00100000:0.0:1788841844.884449:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500657664:12345-0@lo:400: Request processed in 58us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841844.884458:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788841844.884497:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76a81180 x1875736500657664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841844.884509:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500657664:0@lo:400: 00000100:00080000:1.0:1788841844.885783:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788841845.228319:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1788841845.380165:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500658048:0@lo:13: 00000100:00100000:1.0:1788841845.380262:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841845.383033:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500658048 00000100:00100000:2.0:1788841845.383056:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500658048 00000100:00100000:2.0:1788841845.383137:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788841845.383149:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500658048:12345-0@lo:13: 00002000:00000024:2.0:1788841845.383324:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788841845.383438:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500658048:12345-0@lo:13: Request processed in 291us (3176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841845.383445:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788841845.383688:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a4e0b7800 x1875736500658048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841861 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841845.383915:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788841845.383945:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500658048:0@lo:13: 00010000:00010000:0.0:1788841845.641703:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841845.775267:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841845.775430:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489099392 00000100:00100000:0.0:1788841845.775443:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489099392 00000100:00100000:0.0:1788841845.775495:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 113 00000100:00100000:0.0:1788841845.775505:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2348:x1875736489099392:12345-192.168.204.55@tcp:250: 00010000:00080000:0.0:1788841845.775534:0:5844:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 51360ac4-5eeb-41b7-beab-1dfd58163005@192.168.204.55@tcp t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:0.0:1788841845.775562:0:5844:0:(genops.c:1385:class_connect()) connect: client 51360ac4-5eeb-41b7-beab-1dfd58163005, cookie 0x3de1064d33a8b086 00000100:00080000:0.0:1788841845.775703:0:5844:0:(import.c:65:import_set_state_nolock()) ffff8d3a4e198800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788841845.775826:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+5:2348:x1875736489099392:12345-192.168.204.55@tcp:250: Request processed in 321us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841845.775834:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 113 00000100:00100000:3.0:1788841845.790182:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841845.790272:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489099520 00000100:00100000:0.0:1788841845.790284:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489099520 00000100:00100000:0.0:1788841845.790464:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 114 00000100:00100000:0.0:1788841845.790476:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+5:5579:x1875736489099520:12345-192.168.204.55@tcp:101: 00010000:00010000:0.0:1788841845.790496:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841845.790515:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a40030000/0x3de1064d33a8b08d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef1fed expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841845.790547:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a40030000/0x3de1064d33a8b08d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef1fed expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841845.790558:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a40030000/0x3de1064d33a8b08d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef1fed expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841845.790568:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40030000, rc 0) 00000100:00100000:0.0:1788841845.790631:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+6:5579:x1875736489099520:12345-192.168.204.55@tcp:101: Request processed in 157us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841845.790638:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 114 00000100:00100000:3.0:1788841845.797219:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841845.797296:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489099648 00000100:00100000:1.0:1788841845.797306:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489099648 00000100:00100000:1.0:1788841845.797449:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 115 00000100:00100000:1.0:1788841845.797460:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49927850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+6:5579:x1875736489099648:12345-192.168.204.55@tcp:501: 00000100:00100000:1.0:1788841845.797844:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49927850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+6:5579:x1875736489099648:12345-192.168.204.55@tcp:501: Request processed in 385us (636us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788841845.797853:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 115 00000100:00100000:3.0:1788841845.801926:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841845.802087:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489099776 00000100:00100000:0.0:1788841845.802097:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489099776 00000100:00100000:0.0:1788841845.802158:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 116 00000100:00100000:0.0:1788841845.802169:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+6:5579:x1875736489099776:12345-192.168.204.55@tcp:101: 00010000:00010000:0.0:1788841845.802186:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841845.802205:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a40031e00/0x3de1064d33a8b094 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef1ff4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841845.802252:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a40031e00/0x3de1064d33a8b094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef1ff4 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841845.802263:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a40031e00/0x3de1064d33a8b094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef1ff4 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841845.802271:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40031e00, rc 0) 00000100:00100000:0.0:1788841845.802495:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+7:5579:x1875736489099776:12345-192.168.204.55@tcp:101: Request processed in 327us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841845.802502:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 116 00000100:00100000:3.0:1788841845.807289:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841845.807929:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489099904 00000100:00100000:3.0:1788841845.807939:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489099904 00000100:00100000:3.0:1788841845.807994:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 117 00000100:00100000:3.0:1788841845.808005:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+7:5579:x1875736489099904:12345-192.168.204.55@tcp:501: 00000100:00100000:3.0:1788841845.808263:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+8:5579:x1875736489099904:12345-192.168.204.55@tcp:501: Request processed in 259us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841845.808271:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 117 00000100:00100000:3.0:1788841845.810070:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841845.810178:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489100032 00000100:00100000:1.0:1788841845.810198:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489100032 00000100:00100000:1.0:1788841845.810239:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 118 00000100:00100000:1.0:1788841845.810248:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49924050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+8:5579:x1875736489100032:12345-192.168.204.55@tcp:503: 00000100:00100000:1.0:1788841845.810842:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49924050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+8:5579:x1875736489100032:12345-192.168.204.55@tcp:503: Request processed in 592us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841845.810851:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 118 00000100:00100000:3.0:1788841845.817882:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841845.817985:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489100160 00000100:00100000:0.0:1788841845.817996:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489100160 00000100:00100000:0.0:1788841845.818072:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 119 00000100:00100000:0.0:1788841845.818083:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+8:5598:x1875736489100160:12345-192.168.204.55@tcp:502: 00000100:00100000:0.0:1788841845.818455:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+8:5598:x1875736489100160:12345-192.168.204.55@tcp:502: Request processed in 373us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841845.818464:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 119 00000100:00100000:3.0:1788841845.851546:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841845.851895:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489100288 00000100:00100000:1.0:1788841845.851906:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489100288 00000100:00100000:1.0:1788841845.851971:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 120 00000100:00100000:1.0:1788841845.851983:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+8:5598:x1875736489100288:12345-192.168.204.55@tcp:502: 00000100:00100000:1.0:1788841845.852266:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+8:5598:x1875736489100288:12345-192.168.204.55@tcp:502: Request processed in 284us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841845.852274:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 120 00000100:00100000:0.0:1788841845.860431:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841845.860582:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489100416 00000100:00100000:2.0:1788841845.860592:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489100416 00000100:00100000:2.0:1788841845.860649:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 121 00000100:00100000:2.0:1788841845.860658:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+8:5579:x1875736489100416:12345-192.168.204.55@tcp:101: 00010000:00010000:2.0:1788841845.860675:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841845.860723:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a82044200/0x3de1064d33a8b09b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef201e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841845.860754:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a82044200/0x3de1064d33a8b09b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef201e expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841845.860765:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a82044200/0x3de1064d33a8b09b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef201e expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841845.860775:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a82044200, rc 0) 00000100:00100000:2.0:1788841845.860833:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+9:5579:x1875736489100416:12345-192.168.204.55@tcp:101: Request processed in 176us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841845.860841:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 121 00000100:00100000:0.0:1788841845.879139:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841845.879467:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489100544 00000100:00100000:2.0:1788841845.879478:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489100544 00000100:00100000:2.0:1788841845.879544:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 122 00000100:00100000:2.0:1788841845.879556:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+9:5579:x1875736489100544:12345-192.168.204.55@tcp:256: 20000000:01000000:2.0:1788841845.879585:0:5845:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788841845.879607:0:5845:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788841845.879612:0:5845:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788841845.879616:0:5845:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788841845.879619:0:5845:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788841845.883469:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+9:5579:x1875736489100544:12345-192.168.204.55@tcp:256: Request processed in 3902us (4329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841845.883484:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 122 00000100:00100000:1.0:1788841845.905369:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841845.908874:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489100672 00000100:00100000:3.0:1788841845.908892:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489100672 00000100:00100000:3.0:1788841845.908960:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 123 00000100:00100000:3.0:1788841845.908971:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+9:5579:x1875736489100672:12345-192.168.204.55@tcp:101: 00010000:00010000:3.0:1788841845.908989:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841845.909009:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a60052a00/0x3de1064d33a8b0a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2025 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841845.909038:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a60052a00/0x3de1064d33a8b0a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2025 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841845.909048:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a60052a00/0x3de1064d33a8b0a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2025 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841845.909067:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60052a00, rc 0) 00000100:00100000:3.0:1788841845.909136:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+10:5579:x1875736489100672:12345-192.168.204.55@tcp:101: Request processed in 168us (3781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841845.909143:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 123 00000100:00100000:3.0:1788841845.912179:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841845.912224:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489100800 00000100:00100000:3.0:1788841845.912232:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489100800 00000100:00100000:3.0:1788841845.912295:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 124 00000100:00100000:3.0:1788841845.913133:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+10:5579:x1875736489100800:12345-192.168.204.55@tcp:501: 00000100:00100000:3.0:1788841845.913528:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+10:5579:x1875736489100800:12345-192.168.204.55@tcp:501: Request processed in 1221us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841845.913538:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 124 00000100:00100000:3.0:1788841845.918143:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841845.918585:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489100928 00000100:00100000:0.0:1788841845.918595:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489100928 00000100:00100000:0.0:1788841845.918655:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 125 00000100:00100000:0.0:1788841845.918666:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+10:5579:x1875736489100928:12345-192.168.204.55@tcp:503: 00000100:00100000:0.0:1788841845.919080:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+10:5579:x1875736489100928:12345-192.168.204.55@tcp:503: Request processed in 415us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841845.919099:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 125 00000100:00100000:1.0:1788841845.925432:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841845.926270:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489101056 00000100:00100000:3.0:1788841845.926463:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489101056 00000100:00100000:3.0:1788841845.926528:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 126 00000100:00100000:3.0:1788841845.926539:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+10:5603:x1875736489101056:12345-192.168.204.55@tcp:502: 00000100:00100000:3.0:1788841845.927172:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+10:5603:x1875736489101056:12345-192.168.204.55@tcp:502: Request processed in 632us (1750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841845.927183:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 126 00000100:00100000:3.0:1788841845.931825:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841845.932113:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489101184 00000100:00100000:2.0:1788841845.932124:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489101184 00000100:00100000:2.0:1788841845.932194:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 127 00000100:00100000:2.0:1788841845.932206:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+10:5603:x1875736489101184:12345-192.168.204.55@tcp:502: 00000100:00100000:2.0:1788841845.932599:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+10:5603:x1875736489101184:12345-192.168.204.55@tcp:502: Request processed in 394us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841845.932607:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 127 00000100:00100000:2.0:1788841845.947116:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841845.947893:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489101312 00000100:00100000:0.0:1788841845.947905:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489101312 00000100:00100000:0.0:1788841845.947952:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 4 00000100:00100000:0.0:1788841845.947960:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2348:x1875736489101312:12345-192.168.204.55@tcp:38: 00010000:00080000:0.0:1788841845.947988:0:6963:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 090c7b3c-cdb1-4c0e-9553-671552ee3fa2@192.168.204.55@tcp t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:0.0:1788841845.948033:0:6963:0:(genops.c:1385:class_connect()) connect: client 090c7b3c-cdb1-4c0e-9553-671552ee3fa2, cookie 0x3de1064d33a8b0a9 00000004:00100000:0.0:1788841845.948073:0:6963:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:0.0:1788841845.948079:0:6963:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1788841845.992293:0:6963:0:(import.c:65:import_set_state_nolock()) ffff8d3a486f4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788841845.992402:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2348:x1875736489101312:12345-192.168.204.55@tcp:38: Request processed in 44439us (45295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841845.992414:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 4 00000100:00100000:1.0:1788841846.499562:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841846.499616:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841846.499750:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489101440 00000100:00100000:2.0:1788841846.499762:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489101440 00000100:00100000:3.0:1788841846.499802:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489101568 00000100:00100000:3.0:1788841846.499809:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489101568 00000100:00080000:1.0:1788841846.499867:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788841846.499902:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 5 00000100:00100000:2.0:1788841846.499914:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:0:x1875736489101440:12345-192.168.204.55@tcp:41: 00000004:00000024:2.0:1788841846.499963:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788841846.500051:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:0:x1875736489101440:12345-192.168.204.55@tcp:41: Request processed in 130us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841846.500061:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 5 00000100:00100000:2.0:1788841846.500081:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:2.0:1788841846.500088:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:5579:x1875736489101568:12345-192.168.204.55@tcp:41: 00000004:00000024:2.0:1788841846.500099:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788841846.500118:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:5579:x1875736489101568:12345-192.168.204.55@tcp:41: Request processed in 31us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841846.500125:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:3.0:1788841846.502884:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841846.503002:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489101696 00000100:00100000:1.0:1788841846.503012:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489101696 00000100:00100000:1.0:1788841846.503085:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:1.0:1788841846.503095:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:5579:x1875736489101696:12345-192.168.204.55@tcp:40: 00000100:00100000:1.0:1788841846.503176:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:5579:x1875736489101696:12345-192.168.204.55@tcp:40: Request processed in 82us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841846.503184:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:1.0:1788841846.506102:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841846.506153:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841846.506248:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489102080 00000100:00100000:3.0:1788841846.506257:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489102080 00000100:00100000:3.0:1788841846.506307:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:3.0:1788841846.506334:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:5579:x1875736489102080:12345-192.168.204.55@tcp:33: 00000100:00100000:3.0:1788841846.506426:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489102208 00000100:00100000:3.0:1788841846.506429:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489102208 00000100:00100000:3.0:1788841846.506457:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 128 00000100:00100000:3.0:1788841846.506464:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+10:2349:x1875736489102208:12345-192.168.204.55@tcp:400: 00000100:00100000:3.0:1788841846.506525:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+10:2349:x1875736489102208:12345-192.168.204.55@tcp:400: Request processed in 61us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841846.506532:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 128 00000100:00100000:1.0:1788841846.512895:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841846.512949:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841846.518446:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489101824 00000100:00100000:2.0:1788841846.518462:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489101824 00000100:00100000:2.0:1788841846.518510:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489101952 00000100:00100000:2.0:1788841846.518513:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489101952 00000100:00100000:2.0:1788841846.518543:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:2.0:1788841846.518553:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875736489101824:12345-192.168.204.55@tcp:8: 00010000:00080000:2.0:1788841846.518584:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 090c7b3c-cdb1-4c0e-9553-671552ee3fa2@192.168.204.55@tcp t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:2.0:1788841846.518635:0:6696:0:(genops.c:1385:class_connect()) connect: client 090c7b3c-cdb1-4c0e-9553-671552ee3fa2, cookie 0x3de1064d33a8b0b0 00002000:00100000:2.0:1788841846.518647:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 090c7b3c-cdb1-4c0e-9553-671552ee3fa2/ffff8d39445e0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113972 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788841846.518670:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:2.0:1788841846.519938:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788841846.519979:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8d39445e0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788841846.520093:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2348:x1875736489101824:12345-192.168.204.55@tcp:8: Request processed in 1540us (7210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841846.520103:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:2.0:1788841846.520133:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:2.0:1788841846.520140:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875736489101952:12345-192.168.204.55@tcp:8: 00010000:00080000:2.0:1788841846.520161:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 090c7b3c-cdb1-4c0e-9553-671552ee3fa2@192.168.204.55@tcp t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:2.0:1788841846.520183:0:6696:0:(genops.c:1385:class_connect()) connect: client 090c7b3c-cdb1-4c0e-9553-671552ee3fa2, cookie 0x3de1064d33a8b0b7 00002000:00100000:2.0:1788841846.520193:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 090c7b3c-cdb1-4c0e-9553-671552ee3fa2/ffff8d39445e7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113972 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788841846.520202:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:2.0:1788841846.523006:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788841846.523072:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8d39445e1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788841846.523162:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2348:x1875736489101952:12345-192.168.204.55@tcp:8: Request processed in 3019us (10211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841846.523174:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 9 00000004:00080000:0.0:1788841846.530867:0:5853:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 24461us 00000004:00200000:0.0:1788841846.541478:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788841846.541615:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:5579:x1875736489102080:12345-192.168.204.55@tcp:33: Request processed in 35277us (35517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841846.541630:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 0 00010000:00010000:1.0:1788841846.658307:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841846.797780:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841846.799883:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489102336 00000100:00100000:1.0:1788841846.800043:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489102336 00000100:00100000:1.0:1788841846.800204:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:1.0:1788841846.800216:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:5621:x1875736489102336:12345-192.168.204.55@tcp:101: 00010000:00010000:1.0:1788841846.800238:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841846.800317:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531a00/0x3de1064d33a8b0be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef204f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841846.800414:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b0c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841846.800433:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b0c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841846.800448:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b0c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788841846.800489:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788841846.800492:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788841846.800523:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b0c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841846.800550:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531a00/0x3de1064d33a8b0be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef204f expref: 8 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841846.800571:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b0c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef204f expref: 7 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841846.800598:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a428df700) 00010000:00010000:1.0:1788841846.800783:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788841846.800788:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43531e00, rc 0) 00000100:00100000:1.0:1788841846.801054:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:5621:x1875736489102336:12345-192.168.204.55@tcp:101: Request processed in 838us (3283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841846.801063:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:1.0:1788841847.426156:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788841847.426181:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500658176:0@lo:13: 00000100:00100000:1.0:1788841847.426257:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841847.426351:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500658176 00000100:00100000:1.0:1788841847.426359:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500658176 00000100:00100000:1.0:1788841847.426427:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788841847.426437:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500658176:12345-0@lo:13: 00000100:00080000:3.0:1788841847.426452:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788841847.426458:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788841847.426498:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500658176:12345-0@lo:13: Request processed in 62us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841847.426504:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788841847.426566:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7c5d2a00 x1875736500658176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841847.426584:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500658176:0@lo:13: 00000001:00100000:2.0:1788841847.492071:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 090c7b3c-cdb1-4c0e-9553-671552ee3fa2 00010000:00010000:0.0:1788841847.688835:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841848.707950:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841849.009281:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841849.009389:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489102464 00000100:00100000:0.0:1788841849.009399:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489102464 00000100:00100000:0.0:1788841849.009485:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:0.0:1788841849.009498:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:5673:x1875736489102464:12345-192.168.204.55@tcp:41: 00000004:00000024:0.0:1788841849.009542:0:5851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788841849.009624:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:5673:x1875736489102464:12345-192.168.204.55@tcp:41: Request processed in 128us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841849.009632:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00080000:3.0:1788841849.010069:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788841849.015849:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841849.016055:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489102592 00000100:00100000:3.0:1788841849.016066:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489102592 00000100:00100000:3.0:1788841849.016149:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:3.0:1788841849.016160:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b779880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:5673:x1875736489102592:12345-192.168.204.55@tcp:13: 00002000:00000024:3.0:1788841849.016199:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788841849.016282:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b779880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:5673:x1875736489102592:12345-192.168.204.55@tcp:13: Request processed in 123us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841849.016290:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00080000:1.0:1788841849.017445:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788841849.022222:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841849.022417:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489102720 00000100:00100000:3.0:1788841849.022428:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489102720 00000100:00100000:3.0:1788841849.022504:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:3.0:1788841849.022516:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:5673:x1875736489102720:12345-192.168.204.55@tcp:13: 00002000:00000024:3.0:1788841849.022564:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788841849.022645:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:5673:x1875736489102720:12345-192.168.204.55@tcp:13: Request processed in 131us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841849.022662:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00080000:1.0:1788841849.023582:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788841849.730670:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841849.986863:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500658688:0@lo:400: 00000100:00100000:3.0:1788841849.986890:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500658432:0@lo:400: 00000100:00100000:0.0:1788841849.986986:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500658304:0@lo:400: 00000100:00100000:2.0:1788841849.987376:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841849.987421:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500658688 00000100:00100000:1.0:1788841849.987433:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500658688 00000100:00100000:1.0:1788841849.987516:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788841849.987528:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875736500658560:0@lo:400: 00000100:00100000:1.0:1788841849.987529:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500658688:12345-0@lo:400: 00000100:00100000:2.0:1788841849.987577:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841849.987659:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500658560 00000100:00100000:2.0:1788841849.987664:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500658560 00000100:00100000:1.0:1788841849.987704:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500658688:12345-0@lo:400: Request processed in 177us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841849.987739:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788841849.987749:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875736500658560:12345-0@lo:400: 00000100:00100000:2.0:1788841849.987793:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875736500658560:12345-0@lo:400: Request processed in 46us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841849.987801:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788841849.987855:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875736500658560:0@lo:400: 00000100:00080000:2.0:1788841849.987893:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788841849.987899:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788841849.987919:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788841849.987928:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76a83100 x1875736500658688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841849.987942:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500658688:0@lo:400: 00000100:00100000:3.0:1788841849.988184:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841849.988243:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500658432 00000100:00100000:1.0:1788841849.988311:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500658432 00000100:00100000:1.0:1788841849.988338:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788841849.988344:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500658432:12345-0@lo:400: 00000100:00100000:1.0:1788841849.988385:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500658432:12345-0@lo:400: Request processed in 40us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841849.988390:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788841849.988440:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500658944:0@lo:400: 00000100:00100000:3.0:1788841849.988791:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841849.988853:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500658944 00000100:00100000:1.0:1788841849.988989:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500658944 00000100:00100000:1.0:1788841849.989034:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788841849.989042:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500658944:12345-0@lo:400: 00000100:00100000:1.0:1788841849.989082:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500658944:12345-0@lo:400: Request processed in 41us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841849.989088:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788841849.989196:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500658432:0@lo:400: 00010000:00080000:3.0:1788841849.989216:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7616c380 x1875736500658944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841849.989227:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500658944:0@lo:400: 00000100:00080000:2.0:1788841849.991842:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788841849.993232:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841849.993317:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875736500658816:0@lo:400: 00000100:00100000:1.0:1788841849.993364:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841849.993503:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500658304 00000100:00100000:0.0:1788841849.993515:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500658304 00000100:00100000:2.0:1788841849.993658:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500658816 00000100:00100000:2.0:1788841849.993663:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500658816 00000100:00100000:2.0:1788841849.993749:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788841849.993760:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875736500658816:12345-0@lo:400: 00000100:00100000:2.0:1788841849.993848:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875736500658816:12345-0@lo:400: Request processed in 89us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841849.993856:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788841849.993884:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788841849.994097:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788841849.994113:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3310:x1875736500658304:12345-0@lo:400: 00000100:00100000:0.0:1788841849.994157:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3310:x1875736500658304:12345-0@lo:400: Request processed in 53us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841849.994164:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788841849.994371:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500658304:0@lo:400: 00000100:00100000:1.0:1788841849.994390:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875736500658816:0@lo:400: 00000100:00100000:0.0:1788841850.497953:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788841850.501352:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500659072:0@lo:13: 00000100:00100000:1.0:1788841850.501470:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841850.501903:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500659072 00000100:00100000:3.0:1788841850.501915:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500659072 00000100:00100000:3.0:1788841850.502020:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788841850.502035:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500659072:12345-0@lo:13: 00002000:00000024:3.0:1788841850.502081:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788841850.502156:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500659072:12345-0@lo:13: Request processed in 125us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841850.502165:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788841850.508420:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7c5d3480 x1875736500659072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841850.508457:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500659072:0@lo:13: 00010000:00010000:1.0:1788841850.754911:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788841851.099082:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 090c7b3c-cdb1-4c0e-9553-671552ee3fa2 00000001:00100000:1.0:1788841851.609159:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 090c7b3c-cdb1-4c0e-9553-671552ee3fa2 00010000:00010000:2.0:1788841851.781274:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841851.827374:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841851.827446:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841851.827495:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841851.827539:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489102848 00000100:00100000:0.0:1788841851.827554:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489102848 00000100:00100000:2.0:1788841851.827578:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841851.827635:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 130 00000100:00100000:0.0:1788841851.827649:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+10:2350:x1875736489102848:12345-192.168.204.55@tcp:400: 00000100:00100000:0.0:1788841851.827772:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+10:2350:x1875736489102848:12345-192.168.204.55@tcp:400: Request processed in 126us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841851.827864:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489103104 00000100:00100000:1.0:1788841851.827870:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489103104 00000100:00100000:1.0:1788841851.827954:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489103232 00000100:00100000:1.0:1788841851.827958:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489103232 00000100:00100000:1.0:1788841851.827978:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:1.0:1788841851.827986:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76178e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2350:x1875736489103104:12345-192.168.204.55@tcp:400: 00000100:00100000:1.0:1788841851.828045:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76178e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2350:x1875736489103104:12345-192.168.204.55@tcp:400: Request processed in 60us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841851.828168:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:1.0:1788841851.828189:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:1.0:1788841851.828197:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7617ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2350:x1875736489103232:12345-192.168.204.55@tcp:400: 00000100:00100000:1.0:1788841851.828223:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7617ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2350:x1875736489103232:12345-192.168.204.55@tcp:400: Request processed in 28us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841851.828230:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00080000:3.0:1788841851.828250:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788841851.828257:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788841851.828514:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489102976 00000100:00100000:3.0:1788841851.828521:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489102976 00000100:00100000:3.0:1788841851.830219:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 25 00000100:00100000:3.0:1788841851.830240:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7617b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2350:x1875736489102976:12345-192.168.204.55@tcp:400: 00000100:00100000:3.0:1788841851.830338:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7617b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2350:x1875736489102976:12345-192.168.204.55@tcp:400: Request processed in 107us (2842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841851.830347:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 25 00000100:00080000:3.0:1788841851.830388:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788841851.838049:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 130 00000001:02000400:3.0:1788841852.250983:0:8295:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788841852.551407:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788841852.551439:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500659200:0@lo:13: 00000100:00100000:1.0:1788841852.551615:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841852.552314:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500659200 00000100:00100000:2.0:1788841852.552329:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500659200 00000100:00100000:2.0:1788841852.554548:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788841852.554573:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500659200:12345-0@lo:13: 00002000:00000024:2.0:1788841852.554629:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788841852.554761:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500659200:12345-0@lo:13: Request processed in 199us (3146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841852.554770:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788841852.554843:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76178700 x1875736500659200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841852.554870:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500659200:0@lo:13: 00000100:00080000:3.0:1788841852.568798:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788841852.803290:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841853.833471:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841854.850748:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841855.107452:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500659328:0@lo:400: 00000100:00100000:2.0:1788841855.107549:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841855.109301:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500659456:0@lo:400: 00000100:00100000:3.0:1788841855.109377:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841855.109431:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500659968:0@lo:400: 00000100:00100000:3.0:1788841855.109476:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841855.109508:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788841855.109514:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500659584:0@lo:400: 00000100:00100000:3.0:1788841855.109535:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841855.109564:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500659712:0@lo:400: 00000100:00100000:3.0:1788841855.109586:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841855.109605:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788841855.109610:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875736500659840:0@lo:400: 00000100:00100000:3.0:1788841855.109632:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841855.109664:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500659968 00000100:00100000:3.0:1788841855.109672:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500659968 00000100:00100000:3.0:1788841855.109757:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500659712 00000100:00100000:3.0:1788841855.109760:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500659712 00000100:00100000:3.0:1788841855.109779:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788841855.109788:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500659968:12345-0@lo:400: 00000100:00100000:3.0:1788841855.109846:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500659968:12345-0@lo:400: Request processed in 58us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841855.109853:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788841855.109870:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788841855.109888:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500659712:12345-0@lo:400: 00000100:00100000:3.0:1788841855.109921:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500659712:12345-0@lo:400: Request processed in 45us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841855.109944:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788841855.109964:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500659456 00000100:00100000:3.0:1788841855.109968:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500659456 00000100:00100000:3.0:1788841855.109988:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500659584 00000100:00100000:3.0:1788841855.109991:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500659584 00000100:00100000:3.0:1788841855.110001:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500659840 00000100:00100000:3.0:1788841855.110003:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500659840 00000100:00100000:3.0:1788841855.110017:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788841855.110023:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500659456:12345-0@lo:400: 00000100:00100000:3.0:1788841855.110054:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500659456:12345-0@lo:400: Request processed in 31us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841855.110060:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788841855.110073:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788841855.110079:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500659584:12345-0@lo:400: 00000100:00100000:3.0:1788841855.110103:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500659584:12345-0@lo:400: Request processed in 25us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841855.110108:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788841855.110119:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788841855.110124:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875736500659840:12345-0@lo:400: 00000100:00100000:3.0:1788841855.110148:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875736500659840:12345-0@lo:400: Request processed in 25us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841855.110154:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788841855.110182:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788841855.110187:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788841855.110189:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788841855.110225:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875736500659840:0@lo:400: 00010000:00080000:3.0:1788841855.110238:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a75ed3b80 x1875736500659712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841855.110255:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500659712:0@lo:400: 00000100:00100000:3.0:1788841855.110286:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500659584:0@lo:400: 00000100:00100000:3.0:1788841855.110296:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500659456:0@lo:400: 00010000:00080000:3.0:1788841855.110305:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a767cc380 x1875736500659968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841855.110314:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500659968:0@lo:400: 00000100:00100000:1.0:1788841855.111283:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500659328 00000100:00100000:1.0:1788841855.111292:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500659328 00000100:00100000:1.0:1788841855.111337:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788841855.111345:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3310:x1875736500659328:12345-0@lo:400: 00000100:00100000:1.0:1788841855.111462:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3310:x1875736500659328:12345-0@lo:400: Request processed in 117us (3912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841855.111469:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788841855.119620:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500659328:0@lo:400: 00000100:00100000:3.0:1788841855.618247:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788841855.618278:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500660096:0@lo:13: 00000100:00100000:3.0:1788841855.618362:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841855.618550:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500660096 00000100:00100000:0.0:1788841855.618558:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500660096 00000100:00100000:0.0:1788841855.618616:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788841855.618625:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500660096:12345-0@lo:13: 00002000:00000024:0.0:1788841855.618665:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788841855.618747:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500660096:12345-0@lo:13: Request processed in 122us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841855.618754:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788841855.618840:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7c5d2300 x1875736500660096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841855.618861:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500660096:0@lo:13: 00010000:00010000:2.0:1788841855.883281:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788841856.189520:0:8442:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff23bafc50 20000000:00000080:3.0:1788841856.189540:0:8442:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d3944e76800 uarg=0000000000000000 20000000:01000000:3.0:1788841856.189578:0:8442:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788841856.189581:0:8442:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788841856.189584:0:8442:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788841856.189589:0:8442:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788841856.189595:0:8442:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788841856.189942:0:8442:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788841856.189946:0:8442:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788841856.190316:0:8442:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788841856.190320:0:8442:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788841856.203041:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788841856.203634:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788841856.203740:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788841856.203791:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1788841856.203805:0:8442:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788841856.203808:0:8442:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788841856.204832:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788841856.205295:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788841856.205342:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788841856.205394:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1788841856.205410:0:8442:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788841856.205412:0:8442:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788841856.207747:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788841856.208341:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1788841856.208413:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1788841856.208452:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1788841856.208465:0:8442:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788841856.208467:0:8442:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788841856.210673:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788841856.211837:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788841856.211914:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788841856.211953:0:8442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:3.0:1788841856.211972:0:8442:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788841856.211993:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8b0cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.212013:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a40031400/0x3de1064d33a8afc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8afc2 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.212022:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a43531800/0x3de1064d33a8aff3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8afec expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.212031:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a82045400/0x3de1064d33a8b01d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b016 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.212039:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a43530a00/0x3de1064d33a8b02b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b024 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.212046:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a40031000/0x3de1064d33a8b039 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b032 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.212063:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a60053400/0x3de1064d33a8b055 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b04e expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.212070:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a40031800/0x3de1064d33a8b07f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b078 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.212080:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a40030000/0x3de1064d33a8b08d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef1fed expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.212089:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a40031e00/0x3de1064d33a8b094 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef1ff4 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.212097:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8b0cc lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.213692:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a40031e00/0x3de1064d33a8b094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef1ff4 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.214281:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d3a40031e00/0x3de1064d33a8b094 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef1ff4 expref: 9 pid: 5844 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841856.214303:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875736500660224:192.168.204.55@tcp:104: 00010000:00010000:3.0:1788841856.214469:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a40030000/0x3de1064d33a8b08d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef1fed expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.214479:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d3a40030000/0x3de1064d33a8b08d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef1fed expref: 9 pid: 5842 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841856.214488:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875736500660352:192.168.204.55@tcp:104: 00010000:00010000:3.0:1788841856.214534:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a40031800/0x3de1064d33a8b07f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8b078 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.214543:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3a40031800/0x3de1064d33a8b07f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8b078 expref: 18 pid: 5842 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841856.214553:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875736500660480:0@lo:104: 00000100:00100000:3.0:1788841856.214591:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788841856.214632:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a60053400/0x3de1064d33a8b055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8b04e expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.214641:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3a60053400/0x3de1064d33a8b055 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8b04e expref: 18 pid: 5845 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841856.214649:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875736500660608:0@lo:104: 00000100:00100000:3.0:1788841856.214670:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788841856.214698:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a40031000/0x3de1064d33a8b039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8b032 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.214727:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3a40031000/0x3de1064d33a8b039 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8b032 expref: 18 pid: 5845 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841856.214736:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875736500660736:0@lo:104: 00010000:00010000:3.0:1788841856.214769:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a43530a00/0x3de1064d33a8b02b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8b024 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.214777:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3a43530a00/0x3de1064d33a8b02b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8b024 expref: 18 pid: 5842 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841856.214784:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875736500660864:0@lo:104: 00010000:00010000:3.0:1788841856.214816:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a82045400/0x3de1064d33a8b01d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8b016 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.214825:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3a82045400/0x3de1064d33a8b01d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8b016 expref: 18 pid: 5845 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841856.214833:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875736500660992:0@lo:104: 00010000:00010000:3.0:1788841856.214872:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a43531800/0x3de1064d33a8aff3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8afec expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.214880:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3a43531800/0x3de1064d33a8aff3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8afec expref: 18 pid: 5842 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841856.214888:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875736500661120:0@lo:104: 00010000:00010000:3.0:1788841856.214912:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a40031400/0x3de1064d33a8afc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8afc2 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.214920:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3a40031400/0x3de1064d33a8afc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8afc2 expref: 18 pid: 5844 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841856.214928:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875736500661248:0@lo:104: 00000100:00100000:3.0:1788841856.214944:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611c780 going to sleep for 11 seconds 00000100:00100000:0.0:1788841856.215303:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788841856.215325:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841856.215349:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841856.215357:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841856.215365:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841856.215374:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841856.215382:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500660480 00000100:00100000:0.0:1788841856.215388:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500660480 00000100:00100000:0.0:1788841856.215426:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500660608 00000100:00100000:0.0:1788841856.215429:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500660608 00000100:00100000:0.0:1788841856.215438:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500660736 00000100:00100000:0.0:1788841856.215440:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500660736 00000100:00100000:0.0:1788841856.215448:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500660864 00000100:00100000:0.0:1788841856.215450:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500660864 00000100:00100000:0.0:1788841856.215457:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500660992 00000100:00100000:0.0:1788841856.215459:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500660992 00000100:00100000:0.0:1788841856.215467:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500661120 00000100:00100000:0.0:1788841856.215469:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500661120 00000100:00100000:0.0:1788841856.215490:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500661248 00000100:00100000:0.0:1788841856.215493:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500661248 00000100:00100000:0.0:1788841856.215509:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788841856.215517:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+9:8442:x1875736500660480:12345-0@lo:104: 00010000:00010000:0.0:1788841856.215531:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a40030c00/0x3de1064d33a8b078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8b07f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.215585:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788841856.215591:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+9:8442:x1875736500660480:12345-0@lo:104: Request processed in 75us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841856.215599:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788841856.215615:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788841856.215621:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3944566450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+8:8442:x1875736500660608:12345-0@lo:104: 00010000:00010000:0.0:1788841856.215639:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a43530c00/0x3de1064d33a8b04e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8b055 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.215670:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788841856.215675:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3944566450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+8:8442:x1875736500660608:12345-0@lo:104: Request processed in 55us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841856.215682:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788841856.215743:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788841856.215750:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+7:8442:x1875736500660736:12345-0@lo:104: 00010000:00010000:0.0:1788841856.215758:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a43530400/0x3de1064d33a8b032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8b039 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.215784:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788841856.215789:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+7:8442:x1875736500660736:12345-0@lo:104: Request processed in 40us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841856.215795:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788841856.215806:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788841856.215812:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+6:8442:x1875736500660864:12345-0@lo:104: 00010000:00010000:0.0:1788841856.215818:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a43530600/0x3de1064d33a8b024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8b02b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.215841:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788841856.215845:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+6:8442:x1875736500660864:12345-0@lo:104: Request processed in 35us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841856.215851:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788841856.215875:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788841856.215881:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+5:8442:x1875736500660992:12345-0@lo:104: 00010000:00010000:0.0:1788841856.215895:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8b01d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.215923:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788841856.215928:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+5:8442:x1875736500660992:12345-0@lo:104: Request processed in 47us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841856.215934:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788841856.215945:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788841856.215951:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+4:8442:x1875736500661120:12345-0@lo:104: 00010000:00010000:0.0:1788841856.215957:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8afec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8aff3 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.215982:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788841856.215986:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+4:8442:x1875736500661120:12345-0@lo:104: Request processed in 36us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841856.215991:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788841856.216001:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788841856.216007:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+3:8442:x1875736500661248:12345-0@lo:104: 00010000:00010000:0.0:1788841856.216013:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8afc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8afc9 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.216035:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788841856.216040:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+3:8442:x1875736500661248:12345-0@lo:104: Request processed in 33us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841856.216045:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788841856.216068:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788841856.216074:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a40030c00/0x3de1064d33a8b078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8b07f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.216087:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40030c00 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:0.0:1788841856.216091:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a40030c00/0x3de1064d33a8b078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8b07f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.216100:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a40030c00/0x3de1064d33a8b078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8b07f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788841856.216108:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a40030c00/0x3de1064d33a8b078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8b07f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841856.216114:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788841856.217922:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788841856.219273:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788841856.219387:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a43530c00/0x3de1064d33a8b04e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8b055 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841856.219794:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875736500660480:0@lo:104: 00000100:00100000:3.0:1788841856.219806:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875736500660608:0@lo:104: 00000100:00100000:3.0:1788841856.219814:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875736500660736:0@lo:104: 00000100:00100000:3.0:1788841856.219823:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875736500660864:0@lo:104: 00000100:00100000:3.0:1788841856.219832:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875736500660992:0@lo:104: 00000100:00100000:3.0:1788841856.219840:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875736500661120:0@lo:104: 00000100:00100000:3.0:1788841856.219877:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875736500661248:0@lo:104: 00010000:00010000:1.0:1788841856.222582:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43530c00 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:1.0:1788841856.222598:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a43530c00/0x3de1064d33a8b04e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8b055 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.222616:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a43530c00/0x3de1064d33a8b04e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8b055 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788841856.222623:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a43530c00/0x3de1064d33a8b04e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8b055 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841856.222629:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788841856.222689:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a43530c00/0x3de1064d33a8b04e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b055 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.222696:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788841856.222731:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a43530c00/0x3de1064d33a8b04e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b055 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.222737:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a43530c00/0x3de1064d33a8b04e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b055 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.222846:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788841856.222851:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a43530600/0x3de1064d33a8b024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8b02b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.222870:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43530600 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:1.0:1788841856.222874:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a43530600/0x3de1064d33a8b024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8b02b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.222880:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a43530600/0x3de1064d33a8b024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8b02b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788841856.222886:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a43530600/0x3de1064d33a8b024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8b02b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841856.222891:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788841856.222908:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a43530600/0x3de1064d33a8b024 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b02b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.222914:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788841856.222920:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a43530600/0x3de1064d33a8b024 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b02b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.222927:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a43530600/0x3de1064d33a8b024 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b02b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.222935:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788841856.222938:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8b01d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.222955:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43531200 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:1.0:1788841856.222958:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8b01d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.222965:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8b01d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788841856.222971:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8b01d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841856.222976:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788841856.222992:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b016 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b01d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.222998:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788841856.223009:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b016 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b01d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.223015:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b016 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b01d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.223023:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788841856.223026:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8afec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8aff3 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.223032:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43530000 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:1.0:1788841856.223034:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8afec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8aff3 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.223050:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8afec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8aff3 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788841856.223055:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8afec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8aff3 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841856.223060:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788841856.223073:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8afec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8aff3 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.223078:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788841856.223083:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8afec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8aff3 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.223088:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8afec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8aff3 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.223097:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841856.223100:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8afc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8afc9 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.223105:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052800 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:1.0:1788841856.223107:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8afc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8afc9 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.223113:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8afc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8afc9 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788841856.223118:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8afc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8afc9 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841856.223130:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788841856.223146:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8afc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8afc9 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.223152:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788841856.223157:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8afc2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8afc9 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.223164:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8afc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8afc9 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.223171:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841856.223173:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841856.223175:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841856.224077:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500661504:0@lo:103: 00000100:00100000:3.0:1788841856.224178:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841856.224252:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500662016:0@lo:103: 00000100:00100000:3.0:1788841856.224275:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841856.224300:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788841856.224307:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500661632:0@lo:103: 00000100:00100000:3.0:1788841856.224326:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841856.224352:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500661760:0@lo:103: 00000100:00100000:3.0:1788841856.224373:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841856.224382:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500661504 00000100:00100000:3.0:1788841856.224387:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788841856.224391:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500661504 00000100:00100000:3.0:1788841856.224395:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500661888:0@lo:103: 00000100:00100000:3.0:1788841856.224414:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841856.224525:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500662016 00000100:00100000:3.0:1788841856.224530:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500662016 00010000:00010000:3.0:1788841856.224556:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a40031400/0x3de1064d33a8afc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8afc2 expref: 20 pid: 5844 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841856.224580:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500661632 00000100:00100000:3.0:1788841856.224583:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500661632 00010000:00010000:3.0:1788841856.224591:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a43530a00/0x3de1064d33a8b02b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8b024 expref: 21 pid: 5842 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841856.224601:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500661760 00000100:00100000:3.0:1788841856.224604:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500661760 00010000:00010000:3.0:1788841856.224612:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a82045400/0x3de1064d33a8b01d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8b016 expref: 22 pid: 5845 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841856.224621:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500661888 00000100:00100000:3.0:1788841856.224635:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500661888 00010000:00010000:3.0:1788841856.224647:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a43531800/0x3de1064d33a8aff3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8afec expref: 23 pid: 5842 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841856.224661:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788841856.224669:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+23:3309:x1875736500662016:12345-0@lo:103: 00010000:00010000:3.0:1788841856.224683:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841856.224688:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a40031400/0x3de1064d33a8afc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8afc2 expref: 23 pid: 5844 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.224700:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a40031400/0x3de1064d33a8afc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8afc2 expref: 23 pid: 5844 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.224743:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a40031400/0x3de1064d33a8afc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8afc2 expref: 23 pid: 5844 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.224756:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a60053400/0x3de1064d33a8b055 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8b04e expref: 22 pid: 5845 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.224761:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841856.224777:0:5836:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788841856.224786:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788841856.224802:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+22:3309:x1875736500662016:12345-0@lo:103: Request processed in 132us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841856.224810:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788841856.224829:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788841856.224835:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+21:3309:x1875736500661632:12345-0@lo:103: 00010000:00010000:3.0:1788841856.224845:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841856.224849:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a43530a00/0x3de1064d33a8b02b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8b024 expref: 21 pid: 5842 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.224872:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a43530a00/0x3de1064d33a8b02b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8b024 expref: 21 pid: 5842 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.224882:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a43530a00/0x3de1064d33a8b02b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8b024 expref: 21 pid: 5842 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.224898:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841856.224920:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+20:3309:x1875736500661632:12345-0@lo:103: Request processed in 85us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841856.224927:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788841856.224940:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788841856.224945:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3307:x1875736500661760:12345-0@lo:103: 00010000:00010000:3.0:1788841856.224952:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841856.224957:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a82045400/0x3de1064d33a8b01d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8b016 expref: 19 pid: 5845 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.224965:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a82045400/0x3de1064d33a8b01d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8b016 expref: 19 pid: 5845 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.224975:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a82045400/0x3de1064d33a8b01d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8b016 expref: 19 pid: 5845 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.224984:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841856.225018:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:3307:x1875736500661760:12345-0@lo:103: Request processed in 72us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841856.225024:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788841856.225035:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788841856.225041:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:3307:x1875736500661888:12345-0@lo:103: 00010000:00010000:3.0:1788841856.225048:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841856.225052:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a43531800/0x3de1064d33a8aff3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8afec expref: 17 pid: 5842 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.225061:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a43531800/0x3de1064d33a8aff3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8afec expref: 17 pid: 5842 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.225079:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a43531800/0x3de1064d33a8aff3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8afec expref: 17 pid: 5842 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.225089:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841856.225098:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500661760:0@lo:103: 00000100:00100000:3.0:1788841856.225119:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:3307:x1875736500661888:12345-0@lo:103: Request processed in 77us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841856.225126:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500661888:0@lo:103: 00000100:00100000:3.0:1788841856.225130:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788841856.225149:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788841856.225156:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:3309:x1875736500661504:12345-0@lo:103: 00010000:00010000:3.0:1788841856.225163:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841856.225168:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a60053400/0x3de1064d33a8b055 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8b04e expref: 15 pid: 5845 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.225176:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a60053400/0x3de1064d33a8b055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8b04e expref: 15 pid: 5845 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.225186:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a60053400/0x3de1064d33a8b055 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8b04e expref: 15 pid: 5845 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.225198:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841856.225220:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:3309:x1875736500661504:12345-0@lo:103: Request processed in 65us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841856.225225:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788841856.225327:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500661632:0@lo:103: 00000100:00100000:3.0:1788841856.225335:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500661504:0@lo:103: 00000100:00100000:3.0:1788841856.225342:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500662016:0@lo:103: 00000100:00100000:1.0:1788841856.225588:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875736500660352:192.168.204.55@tcp:104: 00010000:00010000:2.0:1788841856.225607:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841856.225611:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841856.225614:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841856.225623:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a43530400/0x3de1064d33a8b032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8b039 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841856.225633:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43530400 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:2.0:1788841856.225637:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a43530400/0x3de1064d33a8b032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8b039 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841856.225652:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a43530400/0x3de1064d33a8b032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8b039 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788841856.225659:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a43530400/0x3de1064d33a8b032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8b039 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841856.225665:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788841856.225704:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a43530400/0x3de1064d33a8b032 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b039 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841856.225748:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788841856.225770:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a43530400/0x3de1064d33a8b032 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b039 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841856.225777:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a43530400/0x3de1064d33a8b032 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b039 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841856.225789:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500662144:0@lo:103: 00010000:00010000:2.0:1788841856.225809:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841856.225813:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841856.225815:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841856.225830:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841856.225906:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500662144 00000100:00100000:1.0:1788841856.225920:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500662144 00010000:00010000:1.0:1788841856.225940:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a40031000/0x3de1064d33a8b039 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8b032 expref: 14 pid: 5845 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841856.225963:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788841856.225970:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:3310:x1875736500662144:12345-0@lo:103: 00010000:00010000:1.0:1788841856.225980:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841856.225984:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a40031000/0x3de1064d33a8b039 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8b032 expref: 14 pid: 5845 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.225993:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a40031000/0x3de1064d33a8b039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8b032 expref: 14 pid: 5845 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.226005:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a40031000/0x3de1064d33a8b039 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8b032 expref: 14 pid: 5845 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.226016:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841856.226047:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:3310:x1875736500662144:12345-0@lo:103: Request processed in 77us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841856.226053:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788841856.226079:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500662144:0@lo:103: 00010000:00010000:0.0:1788841856.227755:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a40030c00/0x3de1064d33a8b078 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b07f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.227770:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788841856.227808:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a40030c00/0x3de1064d33a8b078 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b07f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.227816:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a40030c00/0x3de1064d33a8b078 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b07f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.227884:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841856.227887:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841856.227890:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841856.227987:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788841856.228007:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500661376:0@lo:103: 00000100:00100000:2.0:1788841856.228070:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841856.228272:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500661376 00000100:00100000:0.0:1788841856.228281:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500661376 00010000:00010000:0.0:1788841856.228315:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a40031800/0x3de1064d33a8b07f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8b078 expref: 13 pid: 5842 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841856.228350:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788841856.228375:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4ec19450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:3308:x1875736500661376:12345-0@lo:103: 00010000:00010000:0.0:1788841856.228388:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788841856.228394:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a40031800/0x3de1064d33a8b07f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8b078 expref: 13 pid: 5842 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.228404:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a40031800/0x3de1064d33a8b07f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8b078 expref: 13 pid: 5842 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.228420:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a40031800/0x3de1064d33a8b07f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8b078 expref: 13 pid: 5842 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.228435:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788841856.228518:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4ec19450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:3308:x1875736500661376:12345-0@lo:103: Request processed in 146us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841856.228525:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788841856.232513:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841856.232838:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8442:1875736500660224:192.168.204.55@tcp:104: 00010000:00010000:2.0:1788841856.232901:0:8442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8b0cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841856.233268:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489103360 00000100:00100000:3.0:1788841856.233276:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489103360 00010000:00010000:3.0:1788841856.233312:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a40030000/0x3de1064d33a8b08d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef1fed expref: 10 pid: 5842 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841856.233354:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 19 00000100:00100000:3.0:1788841856.233364:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7617aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51360ac4-5eeb-41b7-beab-1dfd58163005+10:2349:x1875736489103360:12345-192.168.204.55@tcp:103: 00010000:00010000:3.0:1788841856.233378:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841856.233384:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a40030000/0x3de1064d33a8b08d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef1fed expref: 10 pid: 5842 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.233393:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a40030000/0x3de1064d33a8b08d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef1fed expref: 10 pid: 5842 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.233410:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a40030000/0x3de1064d33a8b08d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef1fed expref: 10 pid: 5842 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841856.233426:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841856.233485:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7617aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51360ac4-5eeb-41b7-beab-1dfd58163005+9:2349:x1875736489103360:12345-192.168.204.55@tcp:103: Request processed in 122us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841856.233492:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 19 00000100:00100000:1.0:1788841856.241343:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500661376:0@lo:103: 00000100:00100000:3.0:1788841856.245978:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841856.246267:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489103488 00000100:00100000:0.0:1788841856.246280:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489103488 00010000:00010000:0.0:1788841856.246325:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a40031e00/0x3de1064d33a8b094 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef1ff4 expref: 9 pid: 5844 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841856.246366:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 20 00000100:00100000:0.0:1788841856.246376:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51360ac4-5eeb-41b7-beab-1dfd58163005+9:2350:x1875736489103488:12345-192.168.204.55@tcp:103: 00010000:00010000:0.0:1788841856.246391:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788841856.246397:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a40031e00/0x3de1064d33a8b094 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef1ff4 expref: 9 pid: 5844 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.246409:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a40031e00/0x3de1064d33a8b094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef1ff4 expref: 9 pid: 5844 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.246428:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a40031e00/0x3de1064d33a8b094 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef1ff4 expref: 9 pid: 5844 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.246461:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8b0cc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.246470:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8b0cc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.246487:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8b0cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.246493:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8b0cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.246500:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8b0cc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.246506:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8b0cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.246512:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053800 already unused, calling callback (ffffffffc1813420) 00010000:00010000:0.0:1788841856.246516:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8b0cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.246523:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8b0cc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.246549:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8b0cc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841856.246561:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788841856.246706:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51360ac4-5eeb-41b7-beab-1dfd58163005+8:2350:x1875736489103488:12345-192.168.204.55@tcp:103: Request processed in 331us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841856.246760:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 20 00010000:00010000:1.0:1788841856.246965:0:8442:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8b0cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.246975:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8b0cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.246983:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8b0cc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841856.897891:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841856.935908:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841856.935961:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841856.936327:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489103744 00000100:00100000:1.0:1788841856.936340:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489103744 00000100:00100000:1.0:1788841856.936430:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:1.0:1788841856.936444:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2349:x1875736489103744:12345-192.168.204.55@tcp:400: 00000100:00100000:1.0:1788841856.936536:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2349:x1875736489103744:12345-192.168.204.55@tcp:400: Request processed in 95us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841856.936544:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:0.0:1788841856.937024:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489103616 00000100:00100000:0.0:1788841856.937031:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489103616 00000100:00100000:0.0:1788841856.937085:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 29 00000100:00100000:0.0:1788841856.937094:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2350:x1875736489103616:12345-192.168.204.55@tcp:400: 00000100:00100000:0.0:1788841856.937142:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2350:x1875736489103616:12345-192.168.204.55@tcp:400: Request processed in 49us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841856.937149:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 29 00000100:00080000:3.0:1788841856.944337:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788841856.944352:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788841856.960545:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841856.960735:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489103872 00000100:00100000:3.0:1788841856.960747:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489103872 00000100:00100000:3.0:1788841856.960832:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:3.0:1788841856.960869:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2350:x1875736489103872:12345-192.168.204.55@tcp:400: 00000100:00100000:3.0:1788841856.960960:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2350:x1875736489103872:12345-192.168.204.55@tcp:400: Request processed in 95us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841856.960968:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00080000:0.0:1788841856.962595:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788841857.667160:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7617b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500662272:0@lo:13: 00000100:00100000:1.0:1788841857.667243:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841857.667396:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500662272 00000100:00100000:0.0:1788841857.667404:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500662272 00000100:00100000:0.0:1788841857.667471:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788841857.667482:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500662272:12345-0@lo:13: 00002000:00000024:0.0:1788841857.667525:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788841857.667588:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500662272:12345-0@lo:13: Request processed in 108us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841857.667596:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788841857.667639:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7617b800 x1875736500662272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841857.667657:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7617b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500662272:0@lo:13: 00000100:00080000:1.0:1788841857.667763:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788841857.927764:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788841858.050004:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788841858.050014:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d3944ec2800 from 39 10000000:01000000:1.0:1788841858.050021:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788841858.050074:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8b0d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841858.050084:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8b0d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841858.050095:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8b0d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841858.050126:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500662400:0@lo:101: 00000100:00100000:1.0:1788841858.050214:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841858.050300:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a6827eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788841858.050982:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500662400 00000100:00100000:0.0:1788841858.050993:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500662400 00000100:00100000:0.0:1788841858.051058:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788841858.051067:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+12:5847:x1875736500662400:12345-0@lo:101: 00010000:00010000:0.0:1788841858.051082:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841858.051182:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c78ee00/0x3de1064d33a8b0da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8b0d3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841858.051208:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c78ee00/0x3de1064d33a8b0da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8b0d3 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841858.051219:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c78ee00/0x3de1064d33a8b0da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b0d3 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841858.051228:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78ee00, rc 0) 00000100:00100000:0.0:1788841858.051345:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:5847:x1875736500662400:12345-0@lo:101: Request processed in 278us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841858.051353:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788841858.054032:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500662400:0@lo:101: 00010000:00010000:3.0:1788841858.054076:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8b0d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b0da expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841858.054169:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8b0d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b0da expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841858.054280:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500662528:0@lo:501: 00000100:00100000:3.0:1788841858.054356:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841858.054487:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788841858.061163:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500662528 00000100:00100000:1.0:1788841858.061202:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500662528 00000100:00100000:1.0:1788841858.061419:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788841858.061431:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:5847:x1875736500662528:12345-0@lo:501: 00000100:00100000:1.0:1788841858.061868:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:5847:x1875736500662528:12345-0@lo:501: Request processed in 439us (7511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841858.061877:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788841858.061990:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500662528:0@lo:501: 00000100:00100000:3.0:1788841858.062042:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500662656:0@lo:503: 00000100:00100000:3.0:1788841858.062090:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841858.062443:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611c840 going to sleep for 11 seconds 00000100:00100000:0.0:1788841858.062504:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500662656 00000100:00100000:0.0:1788841858.062509:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500662656 00000100:00100000:0.0:1788841858.062548:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788841858.062557:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:5847:x1875736500662656:12345-0@lo:503: 00000100:00100000:0.0:1788841858.062913:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:5847:x1875736500662656:12345-0@lo:503: Request processed in 357us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841858.062929:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788841858.063108:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500662656:0@lo:503: 00000100:00100000:1.0:1788841858.063578:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8463:1875736500662784:0@lo:502: 00000100:00100000:1.0:1788841858.063624:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841858.063655:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a6827e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788841858.063705:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500662784 00000100:00100000:2.0:1788841858.064068:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500662784 00000100:00100000:2.0:1788841858.064155:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788841858.064165:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:8463:x1875736500662784:12345-0@lo:502: 00000100:00100000:2.0:1788841858.064420:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:8463:x1875736500662784:12345-0@lo:502: Request processed in 255us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841858.064427:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788841858.064509:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8463:1875736500662784:0@lo:502: 00000100:00100000:1.0:1788841858.064554:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8463:1875736500662912:0@lo:502: 00000100:00100000:1.0:1788841858.064590:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841858.075070:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500662912 00000100:00100000:0.0:1788841858.075091:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500662912 00000100:00100000:0.0:1788841858.075169:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788841858.075181:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:8463:x1875736500662912:12345-0@lo:502: 00000100:00100000:0.0:1788841858.075518:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:8463:x1875736500662912:12345-0@lo:502: Request processed in 339us (10926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841858.075527:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788841858.075626:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a6827e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788841858.075652:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8463:1875736500662912:0@lo:502: 00000040:00080000:0.0:1788841858.075697:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788841858.076144:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788841858.076164:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788841858.076176:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8b0d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b0da expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841858.076187:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8b0d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b0da expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788841858.076204:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788841858.076206:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788841858.076208:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788841858.076249:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60053000/0x3de1064d33a8b0e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841858.076257:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a60053000/0x3de1064d33a8b0e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841858.076264:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a60053000/0x3de1064d33a8b0e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841858.076282:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500663040:0@lo:101: 00000100:00100000:3.0:1788841858.076324:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841858.076357:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611c840 going to sleep for 11 seconds 00000100:00100000:0.0:1788841858.076859:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500663040 00000100:00100000:0.0:1788841858.076867:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500663040 00000100:00100000:3.0:1788841858.076969:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788841858.076978:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+13:5847:x1875736500663040:12345-0@lo:101: 00010000:00010000:3.0:1788841858.076990:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841858.077005:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a60053400/0x3de1064d33a8b0e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8b0e1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841858.077031:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a60053400/0x3de1064d33a8b0e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8b0e1 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841858.077041:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a60053400/0x3de1064d33a8b0e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b0e1 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841858.077051:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60053400, rc 0) 00000100:00100000:3.0:1788841858.077120:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:5847:x1875736500663040:12345-0@lo:101: Request processed in 142us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841858.077126:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788841858.077345:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500663040:0@lo:101: 00010000:00010000:0.0:1788841858.077363:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a60053000/0x3de1064d33a8b0e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b0e8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841858.077372:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a60053000/0x3de1064d33a8b0e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b0e8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841858.077427:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500663168:0@lo:501: 00000100:00100000:0.0:1788841858.077457:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841858.077491:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a682b9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788841858.077540:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500663168 00000100:00100000:3.0:1788841858.077545:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500663168 00000100:00100000:3.0:1788841858.077564:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788841858.077570:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:5847:x1875736500663168:12345-0@lo:501: 00000100:00100000:3.0:1788841858.078001:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:5847:x1875736500663168:12345-0@lo:501: Request processed in 428us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841858.078009:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788841858.080508:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500663168:0@lo:501: 00000100:00100000:0.0:1788841858.080574:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500663296:0@lo:503: 00000100:00100000:0.0:1788841858.080664:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841858.080695:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a682b9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788841858.081423:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500663296 00000100:00100000:2.0:1788841858.081433:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500663296 00000100:00100000:2.0:1788841858.081487:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788841858.081498:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:5847:x1875736500663296:12345-0@lo:503: 00000100:00100000:2.0:1788841858.082149:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:5847:x1875736500663296:12345-0@lo:503: Request processed in 651us (1482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841858.082158:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788841858.083047:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500663296:0@lo:503: 00000100:00100000:0.0:1788841858.084129:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767ced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8464:1875736500663424:0@lo:502: 00000100:00100000:0.0:1788841858.084204:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841858.084889:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a682b96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788841858.085028:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500663424 00000100:00100000:1.0:1788841858.085036:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500663424 00000100:00100000:1.0:1788841858.085094:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788841858.085104:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:8464:x1875736500663424:12345-0@lo:502: 00000100:00100000:1.0:1788841858.085419:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:8464:x1875736500663424:12345-0@lo:502: Request processed in 316us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841858.085428:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788841858.085539:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767ced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8464:1875736500663424:0@lo:502: 00000020:01000000:0.0:1788841858.085571:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788841858.085581:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788841858.085584:0:8464:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788841858.085589:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788841858.085625:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767ced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8464:1875736500663552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788841858.085662:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841858.085685:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a682b96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788841858.086017:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500663552 00000100:00100000:2.0:1788841858.086023:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500663552 00000100:00100000:2.0:1788841858.086054:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788841858.086062:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:8464:x1875736500663552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788841858.086192:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:8464:x1875736500663552:12345-0@lo:502:llog_process_th.0 Request processed in 130us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841858.086199:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788841858.086965:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767ced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8464:1875736500663552:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788841858.086998:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788841858.087004:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841858.087007:0:8464:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788841858.087011:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788841858.087252:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788841858.087273:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788841858.087284:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60053000/0x3de1064d33a8b0e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b0e8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841858.087296:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a60053000/0x3de1064d33a8b0e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b0e8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788841858.087306:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788841858.087310:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d3a4e19d800 from 39 10000000:01000000:3.0:1788841858.087312:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788841858.087343:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8b0ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841858.087350:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8b0ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841858.087359:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8b0ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841858.087391:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500663680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788841858.087437:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841858.087479:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611c240 going to sleep for 11 seconds 00000100:00100000:0.0:1788841858.087760:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500663680 00000100:00100000:0.0:1788841858.087767:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500663680 00000100:00100000:0.0:1788841858.087811:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788841858.087829:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:5847:x1875736500663680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788841858.087840:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841858.087853:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c78f400/0x3de1064d33a8b0f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8b0ef expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841858.087875:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c78f400/0x3de1064d33a8b0f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8b0ef expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841858.087886:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c78f400/0x3de1064d33a8b0f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b0ef expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841858.087894:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78f400, rc 0) 00000100:00100000:0.0:1788841858.088115:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:5847:x1875736500663680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 295us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841858.088122:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788841858.088299:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500663680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788841858.088315:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8b0ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b0f6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841858.088324:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8b0ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b0f6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841858.088378:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500663808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788841858.088410:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841858.088445:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788841858.088496:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500663808 00000100:00100000:1.0:1788841858.088501:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500663808 00000100:00100000:1.0:1788841858.088544:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788841858.088551:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:5847:x1875736500663808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788841858.088855:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:5847:x1875736500663808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 304us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841858.088862:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788841858.088990:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500663808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788841858.089024:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500663936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788841858.089062:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841858.089135:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611c240 going to sleep for 11 seconds 00000100:00100000:2.0:1788841858.089644:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500663936 00000100:00100000:2.0:1788841858.089651:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500663936 00000100:00100000:2.0:1788841858.089691:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788841858.089698:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:5847:x1875736500663936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788841858.089904:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:5847:x1875736500663936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 206us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841858.090096:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500663936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788841858.090550:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8465:1875736500664064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788841858.090598:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841858.090638:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788841858.090685:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500664064 00000100:00100000:0.0:1788841858.090690:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500664064 00000100:00100000:2.0:1788841858.090769:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788841858.091441:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788841858.091453:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:8465:x1875736500664064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788841858.091747:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:8465:x1875736500664064:12345-0@lo:502:llog_process_th.0 Request processed in 289us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841858.091756:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788841858.092025:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8465:1875736500664064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788841858.092083:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8465:1875736500664192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788841858.092125:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841858.092162:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a682b9000 going to sleep for 11 seconds 00000100:00100000:3.0:1788841858.092204:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500664192 00000100:00100000:3.0:1788841858.092209:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500664192 00000100:00100000:3.0:1788841858.092319:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788841858.092326:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:8465:x1875736500664192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788841858.092502:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:8465:x1875736500664192:12345-0@lo:502:llog_process_th.0 Request processed in 177us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841858.092509:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788841858.095019:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8465:1875736500664192:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788841858.095110:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788841858.095235:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788841858.095256:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788841858.095268:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8b0ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b0f6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841858.095280:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8b0ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b0f6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841858.095290:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788841858.095293:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788841858.095296:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788841858.095330:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b0fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841858.095338:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b0fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841858.095347:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b0fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841858.095372:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500664320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788841858.095452:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841858.095505:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a6827e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788841858.095570:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500664320 00000100:00100000:3.0:1788841858.095577:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500664320 00000100:00100000:3.0:1788841858.095625:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788841858.095635:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:5847:x1875736500664320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788841858.095648:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841858.095660:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a60053600/0x3de1064d33a8b104 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8b0fd expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841858.095682:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a60053600/0x3de1064d33a8b104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8b0fd expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841858.095692:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a60053600/0x3de1064d33a8b104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b0fd expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841858.095701:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60053600, rc 0) 00000100:00100000:3.0:1788841858.095768:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:5847:x1875736500664320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841858.095785:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788841858.098113:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500664320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788841858.098144:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b0fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b104 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841858.098159:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b0fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b104 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841858.098274:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500664448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788841858.098353:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841858.098411:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a682b9000 going to sleep for 11 seconds 00000100:00100000:1.0:1788841858.099012:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500664448 00000100:00100000:1.0:1788841858.099033:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500664448 00000100:00100000:1.0:1788841858.099087:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788841858.099170:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:5847:x1875736500664448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788841858.101628:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:5847:x1875736500664448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2453us (3267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841858.101642:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788841858.101782:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500664448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788841858.101946:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500664576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788841858.102001:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841858.102049:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a6827e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788841858.102126:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500664576 00000100:00100000:3.0:1788841858.102133:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500664576 00000100:00100000:3.0:1788841858.102181:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788841858.102191:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:5847:x1875736500664576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788841858.102386:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:5847:x1875736500664576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841858.102394:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788841858.102533:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500664576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788841858.103080:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8466:1875736500664704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788841858.103192:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841858.103228:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a682b9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788841858.103275:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500664704 00000100:00100000:1.0:1788841858.103280:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500664704 00000100:00100000:1.0:1788841858.103317:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788841858.103325:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:8466:x1875736500664704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788841858.103492:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:8466:x1875736500664704:12345-0@lo:502:llog_process_th.0 Request processed in 166us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841858.103500:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788841858.103609:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8466:1875736500664704:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788841858.103633:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788841858.103642:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788841858.103644:0:8466:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788841858.103649:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788841858.103669:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8466:1875736500664832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788841858.103699:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841858.103757:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a682b9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788841858.103837:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500664832 00000100:00100000:3.0:1788841858.103842:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500664832 00000100:00100000:3.0:1788841858.103863:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788841858.103870:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:8466:x1875736500664832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788841858.104001:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:8466:x1875736500664832:12345-0@lo:502:llog_process_th.0 Request processed in 131us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841858.104008:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788841858.104049:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8466:1875736500664832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788841858.104070:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788841858.104075:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788841858.104077:0:8466:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788841858.104080:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1788841858.104313:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788841858.104339:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788841858.104349:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b0fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b104 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841858.104361:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b0fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b104 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788841858.104372:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788841858.104375:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d3a43e8f800 from 39 10000000:01000000:3.0:1788841858.104378:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788841858.104403:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60052c00/0x3de1064d33a8b10b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841858.104418:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a60052c00/0x3de1064d33a8b10b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841858.104428:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a60052c00/0x3de1064d33a8b10b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841858.104443:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500664960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788841858.104472:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841858.104494:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788841858.104546:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500664960 00000100:00100000:1.0:1788841858.104551:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500664960 00000100:00100000:1.0:1788841858.104582:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788841858.104590:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:5847:x1875736500664960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788841858.104599:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841858.104611:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a43530600/0x3de1064d33a8b112 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8b10b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841858.104633:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a43530600/0x3de1064d33a8b112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8b10b expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841858.104657:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a43530600/0x3de1064d33a8b112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b10b expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841858.104665:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43530600, rc 0) 00000100:00100000:1.0:1788841858.104731:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:5847:x1875736500664960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841858.104738:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788841858.104941:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500664960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788841858.104955:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a60052c00/0x3de1064d33a8b10b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b112 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841858.104964:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a60052c00/0x3de1064d33a8b10b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b112 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841858.105051:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76179500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500665088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788841858.105079:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841858.105212:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788841858.114186:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500665088 00000100:00100000:1.0:1788841858.114208:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500665088 00000100:00100000:2.0:1788841858.114435:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788841858.114449:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:5847:x1875736500665088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788841858.114950:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:5847:x1875736500665088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 503us (9869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841858.114959:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788841858.115226:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76179500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500665088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788841858.115292:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500665216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788841858.115350:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841858.115397:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788841858.115460:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500665216 00000100:00100000:0.0:1788841858.115473:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500665216 00000100:00100000:0.0:1788841858.115516:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788841858.115525:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:5847:x1875736500665216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788841858.115767:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:5847:x1875736500665216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 243us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841858.115774:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788841858.115885:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500665216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788841858.116279:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8467:1875736500665344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788841858.116317:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841858.116342:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788841858.116882:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500665344 00000100:00100000:2.0:1788841858.116890:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500665344 00000100:00100000:2.0:1788841858.116939:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788841858.116949:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:8467:x1875736500665344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788841858.117325:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:8467:x1875736500665344:12345-0@lo:502:llog_process_th.0 Request processed in 376us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841858.117334:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788841858.117784:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8467:1875736500665344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788841858.117873:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8467:1875736500665472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788841858.117919:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841858.117961:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a682b9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788841858.117971:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500665472 00000100:00100000:3.0:1788841858.117983:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500665472 00000100:00100000:3.0:1788841858.118023:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788841858.118031:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:8467:x1875736500665472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788841858.118208:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:8467:x1875736500665472:12345-0@lo:502:llog_process_th.0 Request processed in 177us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841858.118293:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788841858.119453:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8467:1875736500665472:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788841858.119494:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788841858.119687:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788841858.119742:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788841858.119754:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60052c00/0x3de1064d33a8b10b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b112 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841858.119765:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a60052c00/0x3de1064d33a8b10b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b112 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788841858.119775:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788841858.119778:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788841858.119781:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788841858.119839:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60052600/0x3de1064d33a8b119 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841858.119847:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a60052600/0x3de1064d33a8b119 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841858.119856:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a60052600/0x3de1064d33a8b119 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841858.119878:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500665600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788841858.119938:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841858.119977:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788841858.120388:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500665600 00000100:00100000:1.0:1788841858.120395:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500665600 00000100:00100000:1.0:1788841858.120445:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788841858.120455:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:5847:x1875736500665600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788841858.120470:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841858.120486:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a43530c00/0x3de1064d33a8b120 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8b119 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841858.120510:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a43530c00/0x3de1064d33a8b120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8b119 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841858.120521:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a43530c00/0x3de1064d33a8b120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b119 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841858.120529:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43530c00, rc 0) 00000100:00100000:1.0:1788841858.120587:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500665600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841858.120593:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788841858.120672:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500665600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788841858.120689:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a60052600/0x3de1064d33a8b119 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b120 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841858.121008:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a60052600/0x3de1064d33a8b119 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b120 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841858.121513:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500665728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788841858.121559:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841858.121602:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841858.125429:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500665728 00000100:00100000:0.0:1788841858.125444:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500665728 00000100:00100000:0.0:1788841858.125506:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788841858.125514:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500665728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788841858.125899:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500665728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 384us (4339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841858.125907:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788841858.125981:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500665728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788841858.126040:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500665856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788841858.126089:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841858.126130:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841858.126248:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500665856 00000100:00100000:0.0:1788841858.126253:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500665856 00000100:00100000:0.0:1788841858.126288:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788841858.126296:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500665856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788841858.126455:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500665856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841858.126471:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788841858.126550:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500665856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788841858.126943:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8468:1875736500665984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788841858.126985:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841858.127017:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a6827e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788841858.127062:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500665984 00000100:00100000:0.0:1788841858.127067:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500665984 00000100:00100000:0.0:1788841858.127108:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788841858.127116:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:8468:x1875736500665984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788841858.127286:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:8468:x1875736500665984:12345-0@lo:502:llog_process_th.0 Request processed in 171us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841858.127293:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788841858.127294:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8468:1875736500665984:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788841858.127317:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788841858.127326:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788841858.127329:0:8468:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788841858.127334:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788841858.127359:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7617b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8468:1875736500666112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788841858.127392:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841858.127416:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4ff71900 going to sleep for 11 seconds 00000100:00100000:1.0:1788841858.127427:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500666112 00000100:00100000:1.0:1788841858.127431:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500666112 00000100:00100000:1.0:1788841858.127450:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788841858.127457:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:8468:x1875736500666112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788841858.127595:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:8468:x1875736500666112:12345-0@lo:502:llog_process_th.0 Request processed in 137us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841858.127602:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788841858.128049:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7617b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8468:1875736500666112:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788841858.128073:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788841858.128079:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788841858.128081:0:8468:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788841858.128084:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788841858.130693:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788841858.130745:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788841858.130758:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60052600/0x3de1064d33a8b119 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b120 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841858.130770:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a60052600/0x3de1064d33a8b119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b120 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841858.130781:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788841858.130784:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d3a435699b8 from 1 10000000:01000000:0.0:1788841858.130787:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788841858.130906:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cc800/0x3de1064d33a8b127 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841858.130915:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cc800/0x3de1064d33a8b127 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841858.130934:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cc800/0x3de1064d33a8b127 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841858.130966:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500666240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788841858.131038:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841858.131101:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4ff71900 going to sleep for 11 seconds 00000100:00100000:1.0:1788841858.131175:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500666240 00000100:00100000:1.0:1788841858.131183:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500666240 00000100:00100000:1.0:1788841858.131237:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788841858.131247:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500666240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788841858.131260:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841858.131273:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a43530e00/0x3de1064d33a8b12e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8b127 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841858.131296:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a43530e00/0x3de1064d33a8b12e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8b127 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841858.131307:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a43530e00/0x3de1064d33a8b12e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b127 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841858.131315:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43530e00, rc 0) 00000100:00100000:1.0:1788841858.131360:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:5847:x1875736500666240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841858.131377:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788841858.132346:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500666240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788841858.132368:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cc800/0x3de1064d33a8b127 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b12e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841858.132380:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cc800/0x3de1064d33a8b127 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b12e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841858.132445:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7617b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500666368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788841858.132484:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841858.132521:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4ff71900 going to sleep for 11 seconds 00000100:00100000:3.0:1788841858.132791:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500666368 00000100:00100000:3.0:1788841858.132798:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500666368 00000100:00100000:3.0:1788841858.132849:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788841858.132859:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:5847:x1875736500666368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788841858.133139:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:5847:x1875736500666368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 281us (654us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788841858.133147:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788841858.133308:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7617b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500666368:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788841858.133341:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788841858.133349:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cc800/0x3de1064d33a8b127 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b12e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841858.133358:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cc800/0x3de1064d33a8b127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b12e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841858.947172:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841859.971408:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841860.225964:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500666496:0@lo:400:kworker.0 00000100:00100000:2.0:1788841860.226053:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841860.226197:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500666496 00000100:00100000:0.0:1788841860.226207:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500666496 00000100:00100000:0.0:1788841860.226263:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788841860.226273:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3309:x1875736500666496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841860.226337:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3309:x1875736500666496:12345-0@lo:400:kworker.0 Request processed in 66us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841860.226345:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788841860.226466:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875736500666624:0@lo:400:kworker.0 00000100:00100000:0.0:1788841860.226498:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841860.226559:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500666624 00000100:00100000:1.0:1788841860.226563:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500666624 00000100:00100000:2.0:1788841860.226571:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500666496:0@lo:400:kworker.0 00000100:00100000:1.0:1788841860.226602:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788841860.226610:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875736500666624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841860.226755:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a47d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875736500667008:0@lo:400:kworker.0 00000100:00100000:2.0:1788841860.226794:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841860.226837:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500666752:0@lo:400:kworker.0 00000100:00100000:2.0:1788841860.226870:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841860.226891:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788841860.226897:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a47d41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500666880:0@lo:400:kworker.0 00000100:00100000:2.0:1788841860.226918:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841860.226944:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500667008 00000100:00100000:2.0:1788841860.226948:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500667008 00000100:00100000:2.0:1788841860.226976:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500666752 00000100:00100000:2.0:1788841860.226979:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500666752 00000100:00100000:2.0:1788841860.226992:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788841860.226998:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7617b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875736500667008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841860.227032:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7617b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875736500667008:12345-0@lo:400:kworker.0 Request processed in 33us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841860.227038:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788841860.227054:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788841860.227059:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500666752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841860.227089:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500666752:12345-0@lo:400:kworker.0 Request processed in 29us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841860.227094:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788841860.227112:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500666880 00000100:00100000:2.0:1788841860.227115:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500666880 00000100:00100000:2.0:1788841860.227139:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788841860.227145:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7617bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500666880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841860.227175:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7617bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500666880:12345-0@lo:400:kworker.0 Request processed in 31us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841860.227181:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788841860.227196:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788841860.227200:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788841860.227229:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a47d41f80 x1875736500666880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841860.227241:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a47d41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500666880:0@lo:400:kworker.0 00000100:00100000:2.0:1788841860.227251:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500666752:0@lo:400:kworker.0 00000100:00100000:2.0:1788841860.227278:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a47d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875736500667008:0@lo:400:kworker.0 00000100:00100000:1.0:1788841860.231892:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875736500666624:12345-0@lo:400:kworker.0 Request processed in 5270us (5380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841860.231908:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788841860.236362:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875736500666624:0@lo:400:kworker.0 00000100:00100000:1.0:1788841860.239820:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788841860.239847:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a47d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500667136:0@lo:400:kworker.0 00000100:00100000:1.0:1788841860.239941:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841860.240165:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500667136 00000100:00100000:3.0:1788841860.240174:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500667136 00000100:00100000:3.0:1788841860.240248:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788841860.240259:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500667136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841860.240322:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500667136:12345-0@lo:400:kworker.0 Request processed in 64us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841860.240329:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788841860.240372:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a47d43100 x1875736500667136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841860.240386:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a47d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500667136:0@lo:400:kworker.0 00000100:00080000:1.0:1788841860.240734:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788841860.739988:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788841860.740036:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500667264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788841860.740121:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841860.740644:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500667264 00000100:00100000:1.0:1788841860.740654:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500667264 00000100:00100000:1.0:1788841860.740746:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788841860.740757:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500667264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788841860.740809:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788841860.740887:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500667264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841860.740894:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788841860.741255:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7c5d1f80 x1875736500667264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841860.741277:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500667264:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788841860.993907:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841861.031975:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841861.032235:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489104000 00000100:00100000:1.0:1788841861.032246:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489104000 00000100:00100000:1.0:1788841861.032311:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 165 00000100:00100000:1.0:1788841861.032322:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+8:5593:x1875736489104000:12345-192.168.204.55@tcp:101: 00010000:00010000:1.0:1788841861.032340:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841861.032365:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a43530200/0x3de1064d33a8b135 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2056 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841861.032396:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a43530200/0x3de1064d33a8b135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2056 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841861.032407:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a43530200/0x3de1064d33a8b135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2056 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841861.032415:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43530200, rc 0) 00000100:00100000:1.0:1788841861.032479:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+9:5593:x1875736489104000:12345-192.168.204.55@tcp:101: Request processed in 159us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841861.032486:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 165 00000100:00100000:2.0:1788841861.036263:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841861.036358:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489104128 00000100:00100000:1.0:1788841861.036367:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489104128 00000100:00100000:1.0:1788841861.036433:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 166 00000100:00100000:1.0:1788841861.036444:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+9:5593:x1875736489104128:12345-192.168.204.55@tcp:501: 00000100:00100000:1.0:1788841861.036814:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+9:5593:x1875736489104128:12345-192.168.204.55@tcp:501: Request processed in 370us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841861.036821:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 166 00000100:00100000:2.0:1788841861.040056:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841861.040247:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489104256 00000100:00100000:1.0:1788841861.040257:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489104256 00000100:00100000:1.0:1788841861.040319:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 167 00000100:00100000:1.0:1788841861.040329:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+9:5593:x1875736489104256:12345-192.168.204.55@tcp:503: 00000100:00100000:1.0:1788841861.040740:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+9:5593:x1875736489104256:12345-192.168.204.55@tcp:503: Request processed in 382us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841861.040749:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 167 00000100:00100000:3.0:1788841861.045095:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841861.045207:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489104384 00000100:00100000:0.0:1788841861.045218:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489104384 00000100:00100000:0.0:1788841861.045276:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 168 00000100:00100000:0.0:1788841861.045287:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+9:6086:x1875736489104384:12345-192.168.204.55@tcp:502: 00000100:00100000:0.0:1788841861.045597:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+9:6086:x1875736489104384:12345-192.168.204.55@tcp:502: Request processed in 311us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841861.045606:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 168 00000100:00100000:2.0:1788841861.049165:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841861.049618:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489104512 00000100:00100000:1.0:1788841861.049645:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489104512 00000100:00100000:1.0:1788841861.049828:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 169 00000100:00100000:1.0:1788841861.049839:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+9:6086:x1875736489104512:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788841861.050821:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+9:6086:x1875736489104512:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 979us (1661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841861.050832:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 169 00000100:00100000:2.0:1788841861.063750:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841861.063994:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489104640 00000100:00100000:3.0:1788841861.064006:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489104640 00000100:00100000:3.0:1788841861.064080:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 170 00000100:00100000:3.0:1788841861.064091:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49926050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+9:5593:x1875736489104640:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788841861.064110:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841861.064130:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a60052e00/0x3de1064d33a8b13c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef205d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841861.064163:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a60052e00/0x3de1064d33a8b13c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef205d expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841861.064174:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a60052e00/0x3de1064d33a8b13c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef205d expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841861.064183:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60052e00, rc 0) 00000100:00100000:3.0:1788841861.064248:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49926050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+10:5593:x1875736489104640:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 Request processed in 159us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841861.064256:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 170 00000100:00100000:3.0:1788841861.067636:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841861.070438:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489104768 00000100:00100000:1.0:1788841861.070456:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489104768 00000100:00100000:1.0:1788841861.070789:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 171 00000100:00100000:1.0:1788841861.070802:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+10:5593:x1875736489104768:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788841861.071135:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+10:5593:x1875736489104768:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 Request processed in 335us (3510us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788841861.071143:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 171 00010000:00010000:2.0:1788841862.018060:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841862.053961:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841862.054101:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841862.054143:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841862.054170:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841862.054197:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489105024 00000100:00100000:2.0:1788841862.054207:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489105024 00000100:00100000:2.0:1788841862.054268:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 33 00000100:00100000:2.0:1788841862.054279:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7617a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2349:x1875736489105024:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788841862.054348:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7617a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2349:x1875736489105024:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 72us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841862.054355:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 33 00000100:00080000:2.0:1788841862.054376:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788841862.054436:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489105152 00000100:00100000:3.0:1788841862.054441:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489105152 00000100:00100000:3.0:1788841862.054480:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489105280 00000100:00100000:3.0:1788841862.054491:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489105280 00000100:00100000:3.0:1788841862.054509:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:3.0:1788841862.054516:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7617a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2349:x1875736489105152:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841862.054544:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7617a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2349:x1875736489105152:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 29us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841862.054562:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:3.0:1788841862.054574:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:3.0:1788841862.054580:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2349:x1875736489105280:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841862.054605:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2349:x1875736489105280:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 25us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841862.054611:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00080000:2.0:1788841862.055016:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788841862.055020:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788841862.055347:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489104896 00000100:00100000:0.0:1788841862.055354:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489104896 00000100:00100000:0.0:1788841862.055400:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 172 00000100:00100000:0.0:1788841862.055409:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49924850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+10:2349:x1875736489104896:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788841862.055459:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49924850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+10:2349:x1875736489104896:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 51us (1507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841862.055466:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 172 00000100:00100000:0.0:1788841862.789009:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500667392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788841862.789096:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841862.789180:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500667392 00000100:00100000:0.0:1788841862.789188:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500667392 00000100:00100000:0.0:1788841862.789246:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788841862.789255:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500667392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788841862.789288:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788841862.789334:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500667392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841862.789341:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788841862.789363:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788841862.789393:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a767cf480 x1875736500667392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841862.789411:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500667392:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1788841862.874117:0:8505:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff55ba6160 20000000:00000080:3.0:1788841862.874138:0:8505:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d3945abc000 uarg=0000000000000000 20000000:01000000:3.0:1788841862.874180:0:8505:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788841862.874186:0:8505:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788841862.874190:0:8505:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788841862.876515:0:8506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788841862.880528:0:8505:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788841862.888665:0:8505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788841862.889337:0:8505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788841862.889415:0:8505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788841862.889436:0:8505:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788841862.889458:0:8505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d3a7c78fa00/0x3de1064d33a8b143 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841862.889480:0:8505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a82045c00/0x3de1064d33a8aeb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8aeb1 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841862.889488:0:8505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a40030800/0x3de1064d33a8af1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8af13 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841862.889495:0:8505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8afe5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8afde expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841862.889518:0:8505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a60052a00/0x3de1064d33a8b0a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2025 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841862.889526:0:8505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d3a7c78fa00/0x3de1064d33a8b143 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841862.889570:0:8505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a60052a00/0x3de1064d33a8b0a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2025 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841862.889587:0:8505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d3a60052a00/0x3de1064d33a8b0a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2025 expref: 9 pid: 5844 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841862.889602:0:8505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1875736500667520:192.168.204.55@tcp:104: 00010000:00010000:0.0:1788841862.889767:0:8505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8afe5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8afde expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841862.889776:0:8505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8afe5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8afde expref: 18 pid: 5844 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841862.889785:0:8505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1875736500667648:0@lo:104: 00000100:00100000:0.0:1788841862.889832:0:8505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788841862.889874:0:8505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a40030800/0x3de1064d33a8af1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8af13 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841862.889882:0:8505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3a40030800/0x3de1064d33a8af1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8af13 expref: 18 pid: 5842 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841862.889891:0:8505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1875736500667776:0@lo:104: 00000100:00100000:0.0:1788841862.889923:0:8505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788841862.889947:0:8505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a82045c00/0x3de1064d33a8aeb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8aeb1 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841862.889955:0:8505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3a82045c00/0x3de1064d33a8aeb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8aeb1 expref: 18 pid: 5845 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841862.889963:0:8505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1875736500667904:0@lo:104: 00000100:00100000:0.0:1788841862.889980:0:8505:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e70a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788841862.890161:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788841862.890181:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841862.890196:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500667648 00000100:00100000:1.0:1788841862.890203:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500667648 00000100:00100000:1.0:1788841862.890239:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500667776 00000100:00100000:1.0:1788841862.890242:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500667776 00000100:00100000:1.0:1788841862.890250:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500667904 00000100:00100000:1.0:1788841862.890252:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500667904 00000100:00100000:1.0:1788841862.890265:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788841862.890273:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+5:8505:x1875736500667648:12345-0@lo:104: 00010000:00010000:1.0:1788841862.890285:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a82045a00/0x3de1064d33a8afde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8afe5 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.890336:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788841862.890350:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+5:8505:x1875736500667648:12345-0@lo:104: Request processed in 77us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841862.890357:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788841862.890376:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788841862.890382:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76255050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+4:8505:x1875736500667776:12345-0@lo:104: 00010000:00010000:1.0:1788841862.890390:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8af13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8af1a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.890425:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788841862.890429:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76255050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+4:8505:x1875736500667776:12345-0@lo:104: Request processed in 49us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841862.890435:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788841862.890466:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788841862.890472:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+3:8505:x1875736500667904:12345-0@lo:104: 00010000:00010000:1.0:1788841862.890479:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a82045e00/0x3de1064d33a8aeb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8aeb8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.890511:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788841862.890516:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+3:8505:x1875736500667904:12345-0@lo:104: Request processed in 45us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841862.890522:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788841862.890542:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788841862.890548:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a82045a00/0x3de1064d33a8afde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8afe5 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.890556:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a82045a00 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:1.0:1788841862.890560:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a82045a00/0x3de1064d33a8afde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8afe5 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.890578:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a82045a00/0x3de1064d33a8afde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8afe5 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788841862.890585:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a82045a00/0x3de1064d33a8afde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8afe5 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841862.890591:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788841862.890617:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a82045a00/0x3de1064d33a8afde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8afe5 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.890624:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788841862.890648:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a82045a00/0x3de1064d33a8afde lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8afe5 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.890654:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a82045a00/0x3de1064d33a8afde lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8afe5 expref: -99 pid: 7624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.890667:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788841862.890670:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8af13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8af1a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.890675:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a82045000 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:1.0:1788841862.890677:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8af13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8af1a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.890683:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8af13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8af1a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788841862.890689:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8af13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8af1a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841862.890699:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788841862.890743:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8af13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8af1a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.890749:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788841862.890756:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8af13 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8af1a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.890762:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a82045000/0x3de1064d33a8af13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8af1a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.890770:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841862.890773:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a82045e00/0x3de1064d33a8aeb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8aeb8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.890778:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a82045e00 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:1.0:1788841862.890781:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a82045e00/0x3de1064d33a8aeb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8aeb8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.890787:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a82045e00/0x3de1064d33a8aeb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8aeb8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788841862.890794:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a82045e00/0x3de1064d33a8aeb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8aeb8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841862.890798:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788841862.890810:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a82045e00/0x3de1064d33a8aeb1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8aeb8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.890816:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788841862.890838:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a82045e00/0x3de1064d33a8aeb1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8aeb8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.890845:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a82045e00/0x3de1064d33a8aeb1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8aeb8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.890858:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841862.890860:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841862.890861:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841862.890867:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841862.890872:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841862.890889:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500668032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788841862.890920:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841862.890954:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788841862.890959:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500668160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788841862.890980:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841862.891136:0:8505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1875736500667648:0@lo:104: 00000100:00100000:0.0:1788841862.891145:0:8505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1875736500667776:0@lo:104: 00000100:00100000:0.0:1788841862.891152:0:8505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1875736500667904:0@lo:104: 00000100:00100000:0.0:1788841862.893126:0:8505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1875736500667520:192.168.204.55@tcp:104: 00010000:00010000:0.0:1788841862.893191:0:8505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d3a7c78fa00/0x3de1064d33a8b143 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841862.893576:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500668288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788841862.893627:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841862.893674:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500668032 00000100:00100000:1.0:1788841862.893682:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500668032 00010000:00010000:1.0:1788841862.893755:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8afe5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8afde expref: 19 pid: 5844 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841862.893786:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500668160 00000100:00100000:1.0:1788841862.893790:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500668160 00010000:00010000:1.0:1788841862.893804:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a40030800/0x3de1064d33a8af1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8af13 expref: 20 pid: 5842 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841862.893814:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500668288 00000100:00100000:1.0:1788841862.893816:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500668288 00010000:00010000:1.0:1788841862.893844:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a82045c00/0x3de1064d33a8aeb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8aeb1 expref: 21 pid: 5845 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841862.893858:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788841862.893866:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+21:3309:x1875736500668032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788841862.893879:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841862.893884:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8afe5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8afde expref: 21 pid: 5844 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.893892:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8afe5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8afde expref: 21 pid: 5844 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.893909:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8afe5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8afde expref: 21 pid: 5844 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.893925:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841862.893964:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+20:3309:x1875736500668032:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (3043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841862.893971:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788841862.893990:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788841862.893996:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3309:x1875736500668160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788841862.894004:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841862.894008:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a40030800/0x3de1064d33a8af1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8af13 expref: 19 pid: 5842 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.894016:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a40030800/0x3de1064d33a8af1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8af13 expref: 19 pid: 5842 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.894027:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a40030800/0x3de1064d33a8af1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8af13 expref: 19 pid: 5842 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.894048:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841862.894074:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:3309:x1875736500668160:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (3092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841862.894080:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788841862.894094:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788841862.894099:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:3307:x1875736500668288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788841862.894107:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841862.894111:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a82045c00/0x3de1064d33a8aeb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8aeb1 expref: 17 pid: 5845 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.894119:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a82045c00/0x3de1064d33a8aeb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8aeb1 expref: 17 pid: 5845 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.894129:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a82045c00/0x3de1064d33a8aeb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8aeb1 expref: 17 pid: 5845 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.894138:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841862.894164:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:3307:x1875736500668288:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841862.894170:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788841862.894199:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500668288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788841862.894223:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500668160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788841862.894231:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500668032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788841862.895506:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841862.896685:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489105408 00000100:00100000:1.0:1788841862.896697:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489105408 00010000:00010000:1.0:1788841862.896841:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a60052a00/0x3de1064d33a8b0a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2025 expref: 10 pid: 5844 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841862.896936:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 24 00000100:00100000:1.0:1788841862.896948:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51360ac4-5eeb-41b7-beab-1dfd58163005+10:2349:x1875736489105408:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788841862.896968:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841862.896974:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a60052a00/0x3de1064d33a8b0a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2025 expref: 10 pid: 5844 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.896986:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a60052a00/0x3de1064d33a8b0a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2025 expref: 10 pid: 5844 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.897004:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a60052a00/0x3de1064d33a8b0a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2025 expref: 10 pid: 5844 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.897019:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d3a7c78fa00/0x3de1064d33a8b143 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.897029:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c78fa00/0x3de1064d33a8b143 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.897049:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3a7c78fa00/0x3de1064d33a8b143 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.897056:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3a7c78fa00/0x3de1064d33a8b143 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.897063:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d3a7c78fa00/0x3de1064d33a8b143 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.897070:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d3a7c78fa00/0x3de1064d33a8b143 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.897082:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78fa00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788841862.897086:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d3a7c78fa00/0x3de1064d33a8b143 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.897094:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d3a7c78fa00/0x3de1064d33a8b143 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.897115:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d3a7c78fa00/0x3de1064d33a8b143 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841862.897127:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841862.897186:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51360ac4-5eeb-41b7-beab-1dfd58163005+9:2349:x1875736489105408:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 241us (1686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841862.897194:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 24 00010000:00010000:0.0:1788841862.898995:0:8505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d3a7c78fa00/0x3de1064d33a8b143 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841862.899012:0:8505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d3a7c78fa00/0x3de1064d33a8b143 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841862.899020:0:8505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a7c78fa00/0x3de1064d33a8b143 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841863.042643:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841864.066651:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788841864.450044:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788841864.450054:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3944ec2800 from 4 10000000:01000000:1.0:1788841864.450059:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788841864.450109:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43531000/0x3de1064d33a8b14a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841864.450121:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a43531000/0x3de1064d33a8b14a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841864.450132:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a43531000/0x3de1064d33a8b14a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841864.450159:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500668416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788841864.450238:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841864.450293:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788841864.450437:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500668416 00000100:00100000:3.0:1788841864.450446:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500668416 00000100:00100000:3.0:1788841864.450505:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788841864.450515:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:5847:x1875736500668416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788841864.450528:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841864.450542:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8b151 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8b14a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841864.450566:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8b151 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8b14a expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841864.450576:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8b151 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b14a expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841864.450596:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60053800, rc 0) 00000100:00100000:3.0:1788841864.450646:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:5847:x1875736500668416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841864.450653:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788841864.450951:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500668416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788841864.450967:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a43531000/0x3de1064d33a8b14a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b151 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841864.450977:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a43531000/0x3de1064d33a8b14a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b151 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841864.451044:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500668544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788841864.451073:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841864.451092:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788841864.451195:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500668544 00000100:00100000:2.0:1788841864.451207:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500668544 00000100:00100000:2.0:1788841864.451243:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788841864.451250:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:5847:x1875736500668544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788841864.451497:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:5847:x1875736500668544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841864.451504:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788841864.451575:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500668544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788841864.451602:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500668672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788841864.451638:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841864.451659:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788841864.451675:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500668672 00000100:00100000:0.0:1788841864.451680:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500668672 00000100:00100000:3.0:1788841864.451730:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788841864.451739:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49926c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:5847:x1875736500668672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788841864.452233:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49926c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:5847:x1875736500668672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 495us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841864.452239:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788841864.452335:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500668672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788841864.452679:0:8574:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8574:1875736500668800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788841864.452743:0:8574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841864.452770:0:8574:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841864.452774:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500668800 00000100:00100000:0.0:1788841864.452784:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500668800 00000100:00100000:0.0:1788841864.452817:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788841864.452825:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:8574:x1875736500668800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788841864.452986:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:8574:x1875736500668800:12345-0@lo:502:llog_process_th.0 Request processed in 161us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841864.452993:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788841864.452999:0:8574:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8574:1875736500668800:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788841864.453087:0:8574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788841864.453098:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841864.453100:0:8574:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788841864.453108:0:8574:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d3944ec2800 00000020:00000080:1.0:1788841864.453110:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788841864.453190:0:8574:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8574:1875736500668928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788841864.453229:0:8574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841864.453253:0:8574:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841864.453268:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500668928 00000100:00100000:0.0:1788841864.453272:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500668928 00000100:00100000:0.0:1788841864.453301:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788841864.453308:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:8574:x1875736500668928:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788841864.453424:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:8574:x1875736500668928:12345-0@lo:502:llog_process_th.0 Request processed in 116us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841864.453431:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788841864.454870:0:8574:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8574:1875736500668928:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788841864.454908:0:8574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788841864.454915:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841864.454917:0:8574:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788841864.454922:0:8574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788841864.455204:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788841864.455224:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788841864.455235:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43531000/0x3de1064d33a8b14a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b151 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841864.455245:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a43531000/0x3de1064d33a8b14a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b151 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841864.455256:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788841864.455259:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3a4e19d800 from 4 10000000:01000000:2.0:1788841864.455261:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788841864.455292:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cde00/0x3de1064d33a8b158 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841864.455300:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cde00/0x3de1064d33a8b158 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841864.455308:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cde00/0x3de1064d33a8b158 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841864.455327:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76179c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500669056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788841864.455381:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841864.455418:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a500c03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841864.455501:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500669056 00000100:00100000:0.0:1788841864.455508:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500669056 00000100:00100000:0.0:1788841864.455552:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788841864.455560:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:5847:x1875736500669056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788841864.455572:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841864.455685:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c78f000/0x3de1064d33a8b15f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8b158 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841864.455786:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c78f000/0x3de1064d33a8b15f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8b158 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841864.455949:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c78f000/0x3de1064d33a8b15f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b158 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841864.455960:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78f000, rc 0) 00000100:00100000:0.0:1788841864.456100:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500669056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 540us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841864.456108:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788841864.461476:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76179c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500669056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788841864.461517:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cde00/0x3de1064d33a8b158 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b15f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841864.461531:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cde00/0x3de1064d33a8b158 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b15f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841864.461692:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76179c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500669184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788841864.461782:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841864.461911:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a500c03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788841864.465319:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500669184 00000100:00100000:1.0:1788841864.465335:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500669184 00000100:00100000:1.0:1788841864.465410:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788841864.465421:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49927850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500669184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788841864.465795:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49927850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500669184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 376us (4012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841864.465918:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788841864.466172:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76179c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500669184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788841864.466240:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a47d43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500669312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788841864.466296:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841864.466340:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788841864.466358:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500669312 00000100:00100000:2.0:1788841864.466364:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500669312 00000100:00100000:2.0:1788841864.466403:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788841864.466411:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500669312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788841864.466569:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500669312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841864.466577:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788841864.466610:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a47d43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500669312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788841864.467160:0:8576:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76178000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8576:1875736500669440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788841864.467199:0:8576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841864.467233:0:8576:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a500c00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788841864.468646:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500669440 00000100:00100000:3.0:1788841864.468658:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500669440 00000100:00100000:3.0:1788841864.468735:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788841864.468746:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:8576:x1875736500669440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788841864.469336:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:8576:x1875736500669440:12345-0@lo:502:llog_process_th.0 Request processed in 591us (2135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841864.469344:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788841864.469731:0:8576:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76178000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8576:1875736500669440:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788841864.469768:0:8576:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788841864.469781:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788841864.469783:0:8576:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788841864.469790:0:8576:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d3a4e19d800 00000020:00000080:2.0:1788841864.469793:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788841864.469892:0:8576:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76178000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8576:1875736500669568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788841864.469948:0:8576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841864.469995:0:8576:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a500c00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788841864.471568:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500669568 00000100:00100000:3.0:1788841864.471579:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500669568 00000100:00100000:3.0:1788841864.471637:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788841864.471646:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49924050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:8576:x1875736500669568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788841864.471915:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49924050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:8576:x1875736500669568:12345-0@lo:502:llog_process_th.0 Request processed in 270us (1966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841864.471922:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788841864.472085:0:8576:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76178000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8576:1875736500669568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788841864.472116:0:8576:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788841864.472124:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788841864.472126:0:8576:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788841864.472130:0:8576:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788841864.472216:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788841864.472236:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788841864.472246:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cde00/0x3de1064d33a8b158 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b15f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841864.472257:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cde00/0x3de1064d33a8b158 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b15f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788841864.472268:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788841864.472270:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3a43e8f800 from 4 10000000:01000000:3.0:1788841864.472273:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788841864.472302:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8b166 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841864.472309:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8b166 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841864.472318:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8b166 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841864.472338:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a47d43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500669696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788841864.472370:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841864.472407:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788841864.472674:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500669696 00000100:00100000:2.0:1788841864.472679:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500669696 00000100:00100000:3.0:1788841864.472749:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788841864.472823:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500669696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788841864.472990:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841864.473065:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8b16d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8b166 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841864.473088:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8b16d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8b166 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841864.473098:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8b16d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b166 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841864.473108:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60053e00, rc 0) 00000100:00100000:3.0:1788841864.473153:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:5847:x1875736500669696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 332us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841864.473205:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a47d43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500669696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788841864.473219:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8b166 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b16d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841864.473228:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8b166 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b16d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841864.473276:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500669824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788841864.473305:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841864.473328:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e70ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788841864.473341:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500669824 00000100:00100000:0.0:1788841864.473345:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500669824 00000100:00100000:3.0:1788841864.477606:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788841864.477762:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788841864.477781:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:5847:x1875736500669824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788841864.479289:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:5847:x1875736500669824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1510us (5977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841864.479304:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788841864.479447:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500669824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788841864.479513:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a47d42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500669952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788841864.479563:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841864.479600:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788841864.479662:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500669952 00000100:00100000:0.0:1788841864.479670:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500669952 00000100:00100000:0.0:1788841864.479744:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788841864.479753:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:5847:x1875736500669952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788841864.480240:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:5847:x1875736500669952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 483us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841864.480249:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788841864.481657:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a47d42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500669952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788841864.482195:0:8578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76178000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8578:1875736500670080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788841864.482269:0:8578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841864.482366:0:8578:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a500c00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841864.485475:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500670080 00000100:00100000:0.0:1788841864.485490:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500670080 00000100:00100000:0.0:1788841864.485548:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788841864.485557:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:8578:x1875736500670080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788841864.485881:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:8578:x1875736500670080:12345-0@lo:502:llog_process_th.0 Request processed in 324us (3611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841864.485889:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788841864.486635:0:8578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76178000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8578:1875736500670080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788841864.486676:0:8578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788841864.486686:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841864.486688:0:8578:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788841864.486705:0:8578:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d3a43e8f800 00000020:00000080:1.0:1788841864.486739:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788841864.486813:0:8578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8578:1875736500670208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788841864.486867:0:8578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841864.486901:0:8578:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788841864.486961:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500670208 00000100:00100000:3.0:1788841864.486967:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500670208 00000100:00100000:3.0:1788841864.487361:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788841864.487372:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:8578:x1875736500670208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788841864.487565:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:8578:x1875736500670208:12345-0@lo:502:llog_process_th.0 Request processed in 195us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841864.487580:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788841864.488099:0:8578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:8578:1875736500670208:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788841864.488190:0:8578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788841864.488198:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841864.488201:0:8578:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788841864.488206:0:8578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788841864.490136:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788841864.490186:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788841864.490201:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8b166 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b16d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841864.490217:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8b166 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b16d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841864.872289:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841864.872647:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489105536 00000100:00100000:1.0:1788841864.872668:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489105536 00000100:00100000:1.0:1788841864.872748:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 188 00000100:00100000:1.0:1788841864.872760:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+9:5593:x1875736489105536:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788841864.872777:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841864.872795:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a43531400/0x3de1064d33a8b174 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2064 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841864.872835:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a43531400/0x3de1064d33a8b174 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2064 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841864.872847:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a43531400/0x3de1064d33a8b174 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2064 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841864.872857:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43531400, rc 0) 00000100:00100000:1.0:1788841864.872920:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+10:5593:x1875736489105536:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 Request processed in 163us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841864.872927:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 188 00000100:00100000:3.0:1788841864.877334:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841864.879984:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489105664 00000100:00100000:1.0:1788841864.880009:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489105664 00000100:00100000:1.0:1788841864.880077:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 189 00000100:00100000:1.0:1788841864.880088:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+10:5593:x1875736489105664:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788841864.880413:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+10:5593:x1875736489105664:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 Request processed in 325us (3091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841864.880421:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 189 00000100:00100000:2.0:1788841864.882808:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841864.882945:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489105792 00000100:00100000:0.0:1788841864.882955:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489105792 00000100:00100000:0.0:1788841864.883152:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 190 00000100:00100000:0.0:1788841864.883164:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+10:5593:x1875736489105792:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788841864.883416:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+10:5593:x1875736489105792:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 Request processed in 254us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841864.883424:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 190 00000100:00100000:0.0:1788841864.902743:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841864.902798:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489105920 00000100:00100000:0.0:1788841864.902808:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489105920 00000100:00100000:0.0:1788841864.902934:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 191 00000100:00100000:0.0:1788841864.902946:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+10:6149:x1875736489105920:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788841864.904247:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+10:6149:x1875736489105920:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 1297us (1532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841864.904260:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 191 00000100:00100000:3.0:1788841864.908383:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841864.911905:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489106048 00000100:00100000:0.0:1788841864.911923:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489106048 00000100:00100000:0.0:1788841864.912007:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 192 00000100:00100000:0.0:1788841864.912021:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+10:6149:x1875736489106048:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788841864.912309:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+10:6149:x1875736489106048:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 291us (3935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841864.912317:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 192 00010000:00010000:1.0:1788841865.091851:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841865.346156:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a47d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500670720:0@lo:400:kworker.0 00000100:00100000:2.0:1788841865.346241:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841865.346242:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a47d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500670336:0@lo:400:kworker.0 00000100:00100000:1.0:1788841865.346400:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841865.346453:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a47d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500670464:0@lo:400:kworker.0 00000100:00100000:1.0:1788841865.346455:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a47d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500670848:0@lo:400:kworker.0 00000100:00100000:1.0:1788841865.346480:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841865.346517:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a47d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875736500670592:0@lo:400:kworker.0 00000100:00100000:1.0:1788841865.346540:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841865.346658:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500670720 00000100:00100000:1.0:1788841865.346658:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500670336 00000100:00100000:3.0:1788841865.346665:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500670720 00000100:00100000:1.0:1788841865.346665:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500670336 00000100:00100000:1.0:1788841865.346736:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788841865.346745:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788841865.346746:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3308:x1875736500670336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841865.346752:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76178000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500670720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841865.346966:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500670848 00000100:00100000:0.0:1788841865.346971:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500670848 00000100:00100000:0.0:1788841865.347001:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500670592 00000100:00100000:0.0:1788841865.347004:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500670592 00000100:00100000:0.0:1788841865.347023:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788841865.347030:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500670848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841865.348343:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788841865.348362:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875736500670592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841865.349732:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3308:x1875736500670336:12345-0@lo:400:kworker.0 Request processed in 2981us (3326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841865.349745:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788841865.350256:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841865.350297:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a47d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500670976:0@lo:400:kworker.0 00000100:00100000:1.0:1788841865.350348:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841865.350389:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788841865.350397:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788841865.350492:0:5851:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788841865.350498:0:5851:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788841865.350565:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a47d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500670336:0@lo:400:kworker.0 00000100:00100000:1.0:1788841865.350613:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500670976 00000100:00100000:1.0:1788841865.350620:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500670976 00000100:00100000:1.0:1788841865.350659:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788841865.350668:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788841865.354586:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76178000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500670720:12345-0@lo:400:kworker.0 Request processed in 7820us (8331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841865.354605:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788841865.354658:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788841865.354664:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788841865.354668:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788841865.354758:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a47d41180 x1875736500670720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841865.354776:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a47d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500670720:0@lo:400:kworker.0 00000100:00100000:0.0:1788841865.355015:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500670848:12345-0@lo:400:kworker.0 Request processed in 7983us (8531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841865.355027:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788841865.355062:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500670464 00000100:00100000:0.0:1788841865.355069:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500670464 00000100:00100000:0.0:1788841865.355101:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788841865.355109:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500670464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841865.355168:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500670464:12345-0@lo:400:kworker.0 Request processed in 59us (4913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841865.355175:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788841865.355214:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a47d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500670464:0@lo:400:kworker.0 00000100:00100000:3.0:1788841865.355372:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a47d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500670848:0@lo:400:kworker.0 00000100:00100000:2.0:1788841865.356546:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875736500670592:12345-0@lo:400:kworker.0 Request processed in 8183us (9997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841865.356561:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788841865.356822:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a47d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875736500670592:0@lo:400:kworker.0 00000100:00100000:1.0:1788841865.358747:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500670976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841865.358876:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500670976:12345-0@lo:400:kworker.0 Request processed in 8198us (8525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841865.358886:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788841865.358941:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a47d41500 x1875736500670976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841865.358958:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a47d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500670976:0@lo:400:kworker.0 00000100:00100000:0.0:1788841865.858284:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76864000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500671104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788841865.858362:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841865.858558:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500671104 00000100:00100000:1.0:1788841865.858567:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500671104 00000100:00100000:1.0:1788841865.858621:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788841865.858632:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500671104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788841865.858678:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788841865.858756:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500671104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841865.858763:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788841865.858907:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76864000 x1875736500671104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841865.858930:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76864000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500671104:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788841866.117122:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841867.146846:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841867.172395:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841867.172439:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841867.172466:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841867.172491:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841867.172521:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489106176 00000100:00100000:2.0:1788841867.172531:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489106176 00000100:00100000:2.0:1788841867.172584:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 194 00000100:00100000:2.0:1788841867.172595:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+10:2352:x1875736489106176:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841867.172657:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489106304 00000100:00100000:3.0:1788841867.172662:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489106304 00000100:00100000:2.0:1788841867.172677:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+10:2352:x1875736489106176:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 84us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841867.172685:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 194 00000100:00100000:3.0:1788841867.172700:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 37 00000100:00100000:3.0:1788841867.172724:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2351:x1875736489106304:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841867.172758:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2351:x1875736489106304:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 52us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841867.172763:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 37 00000100:00080000:3.0:1788841867.172779:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788841867.172829:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489106560 00000100:00100000:2.0:1788841867.172833:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489106560 00000100:00100000:2.0:1788841867.172872:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489106432 00000100:00100000:2.0:1788841867.172876:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489106432 00000100:00100000:2.0:1788841867.172899:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 20 00000100:00100000:2.0:1788841867.172906:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2351:x1875736489106560:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788841867.172939:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2351:x1875736489106560:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 34us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841867.172946:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 20 00000100:00100000:2.0:1788841867.172958:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00100000:2.0:1788841867.172964:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7617b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2352:x1875736489106432:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788841867.173000:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7617b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2352:x1875736489106432:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 36us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841867.173007:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00080000:3.0:1788841867.173613:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788841867.173618:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788841867.907019:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788841867.907045:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500671232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788841867.907117:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841867.907187:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500671232 00000100:00100000:0.0:1788841867.907195:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500671232 00000100:00100000:0.0:1788841867.907249:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788841867.907258:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500671232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788841867.907292:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788841867.907337:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500671232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841867.907344:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788841867.907377:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788841867.907406:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a767cfb80 x1875736500671232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841867.907425:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500671232:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788841868.161939:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788841868.928519:0:8806:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788841869.185861:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841870.209925:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841870.468698:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788841870.469643:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875736500671616:0@lo:400:kworker.0 00000100:00100000:0.0:1788841870.469751:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841870.469822:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788841870.469828:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875736500671488:0@lo:400:kworker.0 00000100:00100000:0.0:1788841870.469851:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841870.469889:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500671616 00000100:00100000:0.0:1788841870.469896:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500671616 00000100:00100000:0.0:1788841870.469946:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500671488 00000100:00100000:0.0:1788841870.469963:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500671488 00000100:00100000:0.0:1788841870.469988:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788841870.469996:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875736500671616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841870.470046:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875736500671616:12345-0@lo:400:kworker.0 Request processed in 50us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841870.470053:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788841870.470069:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788841870.470074:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875736500671488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841870.470099:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875736500671488:12345-0@lo:400:kworker.0 Request processed in 25us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841870.470105:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1788841870.470119:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788841870.470149:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875736500671488:0@lo:400:kworker.0 00000100:00100000:0.0:1788841870.470159:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875736500671616:0@lo:400:kworker.0 00000100:00100000:3.0:1788841870.475402:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500671744:0@lo:400:kworker.0 00000100:00100000:3.0:1788841870.475686:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841870.475875:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76865880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500671360:0@lo:400:kworker.0 00000100:00100000:3.0:1788841870.475910:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841870.476243:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500671360 00000100:00100000:0.0:1788841870.476252:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500671360 00000100:00100000:0.0:1788841870.476316:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788841870.476329:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3307:x1875736500671360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841870.476388:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3307:x1875736500671360:12345-0@lo:400:kworker.0 Request processed in 61us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841870.476395:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788841870.478072:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76865880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500671360:0@lo:400:kworker.0 00000100:00100000:0.0:1788841870.478862:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76866d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500671872:0@lo:400:kworker.0 00000100:00100000:0.0:1788841870.478940:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841870.478991:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500671872 00000100:00100000:0.0:1788841870.478998:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500671872 00000100:00100000:0.0:1788841870.479048:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788841870.479070:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500671872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841870.479342:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500671872:12345-0@lo:400:kworker.0 Request processed in 272us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841870.479350:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788841870.479372:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788841870.479395:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76866d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500671872:0@lo:400:kworker.0 00000100:00100000:0.0:1788841870.479430:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788841870.479438:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76864700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500672000:0@lo:400:kworker.0 00000100:00100000:0.0:1788841870.479548:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841870.486892:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500671744 00000100:00100000:2.0:1788841870.486913:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500671744 00000100:00080000:0.0:1788841870.487286:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788841870.488619:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500672000 00000100:00100000:3.0:1788841870.488633:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500672000 00000100:00100000:3.0:1788841870.488736:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788841870.488879:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788841870.489114:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788841870.489126:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500672000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841870.489255:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500672000:12345-0@lo:400:kworker.0 Request processed in 132us (9707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841870.489262:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788841870.489443:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76864700 x1875736500672000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841870.489470:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76864700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500672000:0@lo:400:kworker.0 00000100:00100000:3.0:1788841870.489674:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500671744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841870.489768:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500671744:12345-0@lo:400:kworker.0 Request processed in 1024us (14083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841870.489775:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788841870.492207:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76867100 x1875736500671744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841870.492226:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500671744:0@lo:400:kworker.0 00000100:00100000:2.0:1788841870.978375:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788841870.978401:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76866a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500672128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788841870.978479:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841870.978605:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500672128 00000100:00100000:1.0:1788841870.978613:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500672128 00000100:00100000:1.0:1788841870.978688:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788841870.978699:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500672128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788841870.978763:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788841870.978819:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500672128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841870.978826:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788841870.978878:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76866a00 x1875736500672128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841870.978896:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76866a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500672128:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788841871.239337:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841872.258571:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841872.303988:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841872.304050:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841872.304087:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489106816 00000100:00100000:2.0:1788841872.304096:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489106816 00000100:00100000:2.0:1788841872.304164:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 41 00000100:00100000:2.0:1788841872.304176:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2350:x1875736489106816:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788841872.304269:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2350:x1875736489106816:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 95us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841872.304276:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 41 00000100:00080000:2.0:1788841872.304297:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788841872.304621:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489106688 00000100:00100000:3.0:1788841872.304628:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489106688 00000100:00100000:3.0:1788841872.304671:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 196 00000100:00100000:3.0:1788841872.304693:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+10:2350:x1875736489106688:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841872.304750:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+10:2350:x1875736489106688:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 58us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841872.304756:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 196 00000100:00100000:2.0:1788841872.315032:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841872.315115:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489106944 00000100:00100000:0.0:1788841872.315127:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489106944 00000100:00100000:0.0:1788841872.315191:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:0.0:1788841872.315201:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2348:x1875736489106944:12345-192.168.204.55@tcp:9:kworker.0 00000020:00000080:0.0:1788841872.315239:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8b0b0 00000100:00080000:0.0:1788841872.315250:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8d39445e0800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788841872.315294:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788841872.315397:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841872.315792:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+2:2348:x1875736489106944:12345-192.168.204.55@tcp:9:kworker.0 Request processed in 592us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841872.315808:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:0.0:1788841872.315824:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489107072 00000100:00100000:0.0:1788841872.315828:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489107072 00000100:00100000:0.0:1788841872.315854:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:0.0:1788841872.315861:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2348:x1875736489107072:12345-192.168.204.55@tcp:9:kworker.0 00000020:00000080:0.0:1788841872.315876:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8b0b7 00000100:00080000:0.0:1788841872.315883:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8d39445e1000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788841872.315905:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788841872.316112:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+2:2348:x1875736489107072:12345-192.168.204.55@tcp:9:kworker.0 Request processed in 250us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841872.316119:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00080000:0.0:1788841872.316141:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788841872.316145:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788841872.316212:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841872.316225:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841873.027203:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76866a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500672256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788841873.027292:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841873.041212:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500672256 00000100:00100000:1.0:1788841873.041235:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500672256 00000100:00100000:1.0:1788841873.041312:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788841873.041325:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500672256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788841873.041371:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788841873.042887:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500672256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1560us (15589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841873.042900:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788841873.043061:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76866a00 x1875736500672256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841873.043087:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76866a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500672256:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788841873.043877:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788841873.132042:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 090c7b3c-cdb1-4c0e-9553-671552ee3fa2 00000020:00000080:1.0:1788841873.132052:0:6720:0:(genops.c:885:class_export_put()) final put ffff8d39445e0000/090c7b3c-cdb1-4c0e-9553-671552ee3fa2 00000020:00000080:0.0:1788841873.132077:0:482:0:(genops.c:844:class_export_destroy()) destroying export ffff8d39445e0000/090c7b3c-cdb1-4c0e-9553-671552ee3fa2 for lustre-OST0000 00000020:00000080:0.0:1788841873.132129:0:482:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d39445e0800 for lustre-OST0000 00010000:00010000:0.0:1788841873.294408:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788841874.288559:0:9051:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-server.virtnet: executing yml_node 00010000:00010000:1.0:1788841874.307142:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841875.329952:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841875.588930:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500672384:0@lo:400:kworker.0 00000100:00100000:1.0:1788841875.589008:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841875.589054:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500672896:0@lo:400:kworker.0 00000100:00100000:1.0:1788841875.589080:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841875.589109:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788841875.589115:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500672768:0@lo:400:kworker.0 00000100:00100000:1.0:1788841875.589141:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841875.589170:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76865500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500672512:0@lo:400:kworker.0 00000100:00100000:1.0:1788841875.590069:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841875.590112:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76866300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500673024:0@lo:400:kworker.0 00000100:00100000:1.0:1788841875.590162:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841875.590189:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788841875.590628:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500672896 00000100:00100000:0.0:1788841875.590638:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500672896 00000100:00100000:0.0:1788841875.590690:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500672512 00000100:00100000:0.0:1788841875.590694:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500672512 00000100:00100000:0.0:1788841875.590732:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788841875.590742:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500672896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841875.590856:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76867480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500672640:0@lo:400:kworker.0 00000100:00100000:1.0:1788841875.590889:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841875.590927:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500672384 00000100:00100000:1.0:1788841875.590932:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500672384 00000100:00100000:1.0:1788841875.590961:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788841875.590968:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3308:x1875736500672384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841875.591014:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3308:x1875736500672384:12345-0@lo:400:kworker.0 Request processed in 46us (2006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841875.591022:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788841875.591052:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500672640 00000100:00100000:1.0:1788841875.591056:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500672640 00000100:00100000:1.0:1788841875.591075:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788841875.591080:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500672512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841875.591341:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788841875.591351:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500672640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841875.591389:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500672640:12345-0@lo:400:kworker.0 Request processed in 41us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841875.591395:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788841875.591442:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76867480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500672640:0@lo:400:kworker.0 00000100:00100000:0.0:1788841875.591614:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500672896:12345-0@lo:400:kworker.0 Request processed in 873us (2531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841875.591621:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788841875.592362:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500672512:12345-0@lo:400:kworker.0 Request processed in 1280us (3169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841875.592370:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788841875.592402:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500672768 00000100:00100000:1.0:1788841875.592408:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500672768 00000100:00100000:1.0:1788841875.592442:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500673024 00000100:00100000:1.0:1788841875.592446:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500673024 00000100:00100000:1.0:1788841875.592468:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788841875.592476:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76864380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500672768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841875.592672:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788841875.592680:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76866a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500673024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841875.596053:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76866a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500673024:12345-0@lo:400:kworker.0 Request processed in 3362us (5878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841875.596069:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1788841875.597857:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788841875.597868:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788841875.597871:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788841875.601985:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76864a80 x1875736500672768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841875.602006:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500672768:0@lo:400:kworker.0 00000100:00100000:3.0:1788841875.602019:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500672384:0@lo:400:kworker.0 00000100:00100000:3.0:1788841875.602031:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500672896:0@lo:400:kworker.0 00000100:00100000:1.0:1788841875.605374:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76864380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500672768:12345-0@lo:400:kworker.0 Request processed in 12888us (16221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841875.605389:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788841875.606349:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76865500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500672512:0@lo:400:kworker.0 00010000:00080000:2.0:1788841875.606384:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76866300 x1875736500673024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841875.606396:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76866300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500673024:0@lo:400:kworker.0 00000100:00100000:2.0:1788841876.098101:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788841876.098127:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76864700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500673152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788841876.098204:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841876.098309:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500673152 00000100:00100000:1.0:1788841876.098317:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500673152 00000100:00100000:1.0:1788841876.098371:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788841876.098382:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500673152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788841876.098432:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788841876.098503:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500673152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841876.098511:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788841876.098736:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76864700 x1875736500673152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841876.098764:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76864700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500673152:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788841876.356226:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788841877.214379:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 090c7b3c-cdb1-4c0e-9553-671552ee3fa2 00000020:00000080:1.0:1788841877.214392:0:7641:0:(genops.c:885:class_export_put()) final put ffff8d39445e7800/090c7b3c-cdb1-4c0e-9553-671552ee3fa2 00000020:00000080:1.0:1788841877.214427:0:482:0:(genops.c:844:class_export_destroy()) destroying export ffff8d39445e7800/090c7b3c-cdb1-4c0e-9553-671552ee3fa2 for lustre-OST0001 00000020:00000080:1.0:1788841877.214500:0:482:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d39445e1000 for lustre-OST0001 00010000:00010000:0.0:1788841877.378538:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841877.415971:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841877.416040:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841877.416268:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489107328 00000100:00100000:0.0:1788841877.416278:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489107328 00000100:00100000:0.0:1788841877.416358:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 45 00000100:00100000:0.0:1788841877.416369:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2352:x1875736489107328:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788841877.416457:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2352:x1875736489107328:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 79us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841877.416465:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 45 00000100:00100000:2.0:1788841877.417031:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489107200 00000100:00100000:2.0:1788841877.417037:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489107200 00000100:00100000:2.0:1788841877.417074:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 198 00000100:00100000:2.0:1788841877.417082:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+10:2352:x1875736489107200:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788841877.417114:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+10:2352:x1875736489107200:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 33us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841877.417121:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 198 00000100:00080000:3.0:1788841877.417271:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788841878.147360:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76866d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500673280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788841878.147578:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841878.147761:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500673280 00000100:00100000:2.0:1788841878.147770:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500673280 00000100:00100000:2.0:1788841878.147825:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788841878.147834:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76865880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500673280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788841878.147870:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788841878.147964:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76865880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500673280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841878.147973:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788841878.147997:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788841878.148508:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76866d80 x1875736500673280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841878.148530:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76866d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500673280:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788841878.401821:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788841879.129175:0:9243:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.114 00010000:00010000:3.0:1788841879.427036:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841880.449952:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841880.706189:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788841880.706215:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500673408:0@lo:400:kworker.0 00000100:00100000:1.0:1788841880.706295:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841880.706368:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788841880.706376:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875736500673536:0@lo:400:kworker.0 00000100:00100000:1.0:1788841880.706421:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841880.706453:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500673536 00000100:00100000:1.0:1788841880.706460:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500673536 00000100:00100000:1.0:1788841880.706519:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788841880.706542:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875736500673536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841880.706592:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875736500673536:12345-0@lo:400:kworker.0 Request processed in 51us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841880.706600:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788841880.706644:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875736500673536:0@lo:400:kworker.0 00000100:00100000:2.0:1788841880.707199:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500674048:0@lo:400:kworker.0 00000100:00100000:2.0:1788841880.707237:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841880.707275:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788841880.707281:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500673664:0@lo:400:kworker.0 00000100:00100000:2.0:1788841880.707304:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841880.707367:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500674048 00000100:00100000:0.0:1788841880.707373:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500674048 00000100:00100000:0.0:1788841880.707488:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788841880.707497:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500674048:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788841880.707682:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788841880.707854:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500674048:12345-0@lo:400:kworker.0 Request processed in 357us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841880.707862:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788841880.707950:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500673920:0@lo:400:kworker.0 00000100:00100000:3.0:1788841880.707985:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841880.708012:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788841880.708018:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500673792:0@lo:400:kworker.0 00000100:00100000:3.0:1788841880.708167:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841880.708195:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500673408 00000100:00100000:3.0:1788841880.708200:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500673408 00000100:00100000:3.0:1788841880.708226:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788841880.708233:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3307:x1875736500673408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841880.708265:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3307:x1875736500673408:12345-0@lo:400:kworker.0 Request processed in 32us (1970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841880.708271:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788841880.708295:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500673792 00000100:00100000:3.0:1788841880.708299:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500673792 00000100:00100000:3.0:1788841880.708324:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788841880.708330:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500673792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841880.708362:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500673792:12345-0@lo:400:kworker.0 Request processed in 32us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841880.708369:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788841880.708477:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788841880.708504:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a767cdf80 x1875736500674048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841880.708517:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500674048:0@lo:400:kworker.0 00000100:00100000:1.0:1788841880.708681:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500673664 00000100:00100000:1.0:1788841880.708686:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500673664 00000100:00100000:1.0:1788841880.708748:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500673920 00000100:00100000:1.0:1788841880.708751:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500673920 00000100:00100000:1.0:1788841880.708770:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788841880.708777:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500673664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841880.708817:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500673664:12345-0@lo:400:kworker.0 Request processed in 41us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841880.708824:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788841880.708836:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788841880.708842:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500673920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841880.708867:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500673920:12345-0@lo:400:kworker.0 Request processed in 25us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841880.708873:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788841880.708910:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500673408:0@lo:400:kworker.0 00000100:00080000:2.0:1788841880.709190:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788841880.709210:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500673664:0@lo:400:kworker.0 00010000:00080000:3.0:1788841880.709281:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a767cc000 x1875736500673792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841880.709292:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500673792:0@lo:400:kworker.0 00000100:00100000:3.0:1788841880.709304:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500673920:0@lo:400:kworker.0 00000100:00100000:2.0:1788841881.218129:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500674176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788841881.218205:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841881.218403:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500674176 00000100:00100000:1.0:1788841881.218412:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500674176 00000100:00100000:1.0:1788841881.218463:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788841881.218473:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500674176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788841881.218506:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788841881.218579:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500674176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841881.218586:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788841881.218669:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76864e00 x1875736500674176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841881.218688:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500674176:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788841881.473943:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788841881.930344:0:9340:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.114 00010000:00010000:1.0:1788841882.497832:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841882.532969:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841882.533083:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489107456 00000100:00100000:2.0:1788841882.533101:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489107456 00000100:00100000:2.0:1788841882.533176:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 200 00000100:00100000:2.0:1788841882.533189:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+10:2350:x1875736489107456:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788841882.533292:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+10:2350:x1875736489107456:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 104us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841882.533299:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 200 00000100:00100000:2.0:1788841882.534882:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841882.541477:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489107584 00000100:00100000:0.0:1788841882.541496:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489107584 00000100:00100000:0.0:1788841882.541625:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 49 00000100:00100000:0.0:1788841882.541640:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2350:x1875736489107584:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788841882.541766:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2350:x1875736489107584:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 129us (6890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841882.541774:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 49 00000100:00080000:3.0:1788841882.542175:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788841883.267278:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500674304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788841883.267823:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841883.268015:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500674304 00000100:00100000:0.0:1788841883.268024:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500674304 00000100:00100000:0.0:1788841883.268091:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788841883.268100:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76864000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500674304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788841883.268137:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788841883.268204:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76864000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500674304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841883.268211:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788841883.268754:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788841883.268798:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76865f80 x1875736500674304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841883.268820:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500674304:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788841883.522149:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841884.545905:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788841884.981861:0:9437:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.114 00010000:00010000:0.0:1788841885.572305:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841885.826421:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788841885.827518:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500674560:0@lo:400:kworker.0 00000100:00100000:3.0:1788841885.827617:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841885.827703:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788841885.827726:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76864700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500674688:0@lo:400:kworker.0 00000100:00100000:3.0:1788841885.827750:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841885.828772:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76866300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500674816:0@lo:400:kworker.0 00000100:00100000:2.0:1788841885.828833:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841885.829054:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788841885.829067:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500675072:0@lo:400:kworker.0 00000100:00100000:2.0:1788841885.829132:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500674432:0@lo:400:kworker.0 00000100:00100000:3.0:1788841885.829252:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500674816 00000100:00100000:3.0:1788841885.829262:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500674816 00000100:00100000:3.0:1788841885.829349:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788841885.829360:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500674816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841885.832423:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500674560 00000100:00100000:0.0:1788841885.832444:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500674560 00000100:00100000:0.0:1788841885.832503:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500674688 00000100:00100000:0.0:1788841885.832507:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500674688 00000100:00100000:0.0:1788841885.832538:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788841885.832548:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500674560:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788841885.833460:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788841885.833471:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788841885.833689:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841885.834179:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788841885.834201:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500674688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841885.834386:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500674688:12345-0@lo:400:kworker.0 Request processed in 87us (6526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841885.834396:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788841885.834446:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76865500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500674944:0@lo:400:kworker.0 00000100:00100000:1.0:1788841885.834545:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841885.834585:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500674944 00000100:00100000:1.0:1788841885.834593:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500674944 00000100:00100000:1.0:1788841885.834639:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788841885.834646:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500674944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841885.834703:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500674944:12345-0@lo:400:kworker.0 Request processed in 57us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841885.834846:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788841885.834865:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788841885.834905:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76865500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500674944:0@lo:400:kworker.0 00000100:00100000:1.0:1788841885.834944:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76864700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500674688:0@lo:400:kworker.0 00000100:00100000:1.0:1788841885.836134:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500675072 00000100:00100000:1.0:1788841885.836146:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500675072 00000100:00100000:1.0:1788841885.836208:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788841885.836218:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76867800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500675072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841885.836331:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76867800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500675072:12345-0@lo:400:kworker.0 Request processed in 115us (2646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841885.836339:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788841885.836361:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788841885.836471:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76867b80 x1875736500675072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841885.836497:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500675072:0@lo:400:kworker.0 00000100:00100000:2.0:1788841885.836504:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841885.836622:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500674432 00000100:00100000:2.0:1788841885.836628:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500674432 00000100:00100000:2.0:1788841885.836661:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788841885.836669:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3307:x1875736500674432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841885.836731:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3307:x1875736500674432:12345-0@lo:400:kworker.0 Request processed in 42us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841885.836739:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788841885.836804:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500674432:0@lo:400:kworker.0 00000100:00100000:3.0:1788841885.837064:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500674816:12345-0@lo:400:kworker.0 Request processed in 7702us (8227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841885.837076:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788841885.837115:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76866300 x1875736500674816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841885.837127:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76866300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500674816:0@lo:400:kworker.0 00000100:00100000:0.0:1788841885.837488:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500674560:12345-0@lo:400:kworker.0 Request processed in 4938us (9868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841885.837499:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788841885.840818:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500674560:0@lo:400:kworker.0 00000100:00100000:2.0:1788841886.339127:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500675200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788841886.339231:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841886.339749:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500675200 00000100:00100000:1.0:1788841886.339762:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500675200 00000100:00100000:1.0:1788841886.339835:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788841886.339852:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500675200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788841886.339912:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788841886.339990:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500675200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841886.339998:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788841886.340067:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76867b80 x1875736500675200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841886.340093:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500675200:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788841886.568573:0:9486:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 8 00:31:24 EDT 2026 00010000:00010000:2.0:1788841886.596583:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841887.618004:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841887.654130:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841887.654200:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841887.654626:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489107712 00000100:00100000:3.0:1788841887.654644:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489107712 00000100:00100000:3.0:1788841887.654806:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 202 00000100:00100000:3.0:1788841887.654823:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+10:2352:x1875736489107712:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841887.654949:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+10:2352:x1875736489107712:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 131us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841887.654958:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 202 00000100:00100000:0.0:1788841887.655165:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489107840 00000100:00100000:0.0:1788841887.655170:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489107840 00000100:00080000:1.0:1788841887.655225:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788841887.655237:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 53 00000100:00100000:0.0:1788841887.655266:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2352:x1875736489107840:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788841887.655307:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2352:x1875736489107840:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 45us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841887.662396:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 53 00000100:00100000:1.0:1788841888.405590:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500675328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788841888.405697:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841888.405846:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500675328 00000100:00100000:1.0:1788841888.405858:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500675328 00000100:00100000:1.0:1788841888.405936:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788841888.405952:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76864700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500675328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788841888.406004:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788841888.406071:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76864700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500675328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841888.406080:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788841888.407507:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788841888.408511:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76867b80 x1875736500675328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841888.408545:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500675328:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788841888.648899:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841889.666917:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841890.695085:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841890.951338:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a47d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500675456:0@lo:400:kworker.0 00000100:00100000:1.0:1788841890.951449:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841890.951591:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500675456 00000100:00100000:2.0:1788841890.951602:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500675456 00000100:00100000:2.0:1788841890.951686:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788841890.951698:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3308:x1875736500675456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841890.955448:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a47d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500675840:0@lo:400:kworker.0 00000100:00100000:0.0:1788841890.955559:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841890.955689:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500675840 00000100:00100000:0.0:1788841890.955700:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500675840 00000100:00100000:0.0:1788841890.955813:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788841890.955826:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500675840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841890.956305:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500675840:12345-0@lo:400:kworker.0 Request processed in 480us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841890.956315:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788841890.956349:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788841890.956396:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a47d40000 x1875736500675840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841890.956413:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a47d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500675840:0@lo:400:kworker.0 00000100:00100000:0.0:1788841890.956579:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a47d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500675584:0@lo:400:kworker.0 00000100:00100000:0.0:1788841890.956622:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841890.956752:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788841890.956762:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a47d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500675712:0@lo:400:kworker.0 00000100:00100000:0.0:1788841890.956916:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841890.957032:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500675584 00000100:00100000:0.0:1788841890.957039:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500675584 00000100:00100000:0.0:1788841890.957098:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500675712 00000100:00100000:0.0:1788841890.957102:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500675712 00000100:00100000:0.0:1788841890.957131:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788841890.957140:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500675584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841890.957196:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500675584:12345-0@lo:400:kworker.0 Request processed in 46us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841890.957203:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788841890.957217:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788841890.957224:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500675712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841890.957251:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500675712:12345-0@lo:400:kworker.0 Request processed in 28us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841890.957257:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1788841890.957285:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788841890.957309:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a47d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500675712:0@lo:400:kworker.0 00000100:00100000:0.0:1788841890.957320:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a47d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500675584:0@lo:400:kworker.0 00000100:00100000:2.0:1788841890.960407:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3308:x1875736500675456:12345-0@lo:400:kworker.0 Request processed in 8697us (8943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841890.960439:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788841890.962499:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a47d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500675456:0@lo:400:kworker.0 00000100:00100000:2.0:1788841890.963278:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a47d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500676096:0@lo:400:kworker.0 00000100:00100000:2.0:1788841890.963373:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841890.963994:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788841890.964011:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a47d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875736500675968:0@lo:400:kworker.0 00000100:00100000:0.0:1788841890.964072:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841890.964351:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500675968 00000100:00100000:2.0:1788841890.964362:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500675968 00000100:00100000:2.0:1788841890.964457:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788841890.964488:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875736500675968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841890.964569:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875736500675968:12345-0@lo:400:kworker.0 Request processed in 84us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841890.964578:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788841890.964635:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a47d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875736500675968:0@lo:400:kworker.0 00000100:00100000:3.0:1788841890.965117:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500676096 00000100:00100000:3.0:1788841890.965124:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500676096 00000100:00100000:3.0:1788841890.965171:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788841890.965181:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500676096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841890.965248:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500676096:12345-0@lo:400:kworker.0 Request processed in 69us (1875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841890.965255:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788841890.965341:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a47d42680 x1875736500676096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841890.965355:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a47d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500676096:0@lo:400:kworker.0 00000100:00080000:0.0:1788841890.965435:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788841890.965441:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788841891.461779:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500676224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788841891.461885:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841891.462048:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500676224 00000100:00100000:1.0:1788841891.462060:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500676224 00000100:00100000:1.0:1788841891.462124:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788841891.462136:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500676224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788841891.462868:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788841891.463029:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500676224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 892us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841891.463039:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788841891.463165:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76867b80 x1875736500676224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841891.463291:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500676224:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788841891.716913:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841892.737916:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841892.773950:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841892.773999:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841892.774038:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489107968 00000100:00100000:3.0:1788841892.774051:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489107968 00000100:00100000:3.0:1788841892.774118:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 204 00000100:00100000:3.0:1788841892.774133:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+10:2350:x1875736489107968:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841892.774252:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+10:2350:x1875736489107968:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 122us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841892.774262:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 204 00000100:00100000:0.0:1788841892.774879:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489108096 00000100:00100000:0.0:1788841892.774890:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489108096 00000100:00100000:0.0:1788841892.774957:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 57 00000100:00100000:0.0:1788841892.774967:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2349:x1875736489108096:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788841892.775022:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2349:x1875736489108096:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 58us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841892.775045:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 57 00000100:00080000:0.0:1788841892.775077:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788841893.507397:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788841893.507429:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76865500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500676352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788841893.507522:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841893.510606:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500676352 00000100:00100000:2.0:1788841893.510625:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500676352 00000100:00100000:2.0:1788841893.510733:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788841893.510746:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76867480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500676352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788841893.510802:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788841893.511340:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76867480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500676352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 596us (3816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841893.511350:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788841893.511435:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788841893.511536:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76865500 x1875736500676352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841893.511562:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76865500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500676352:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788841893.769798:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841894.786974:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841895.809991:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841896.069956:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76865500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500676480:0@lo:400:kworker.0 00000100:00100000:2.0:1788841896.070041:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841896.070154:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500676480 00000100:00100000:0.0:1788841896.070163:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500676480 00000100:00100000:0.0:1788841896.070217:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788841896.070228:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3308:x1875736500676480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841896.071453:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76866300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500676864:0@lo:400:kworker.0 00000100:00100000:3.0:1788841896.071506:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841896.071754:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3308:x1875736500676480:12345-0@lo:400:kworker.0 Request processed in 1525us (1710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841896.071765:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788841896.071819:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500676864 00000100:00100000:0.0:1788841896.071826:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500676864 00000100:00100000:0.0:1788841896.071875:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788841896.071885:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500676864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841896.071932:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500676864:12345-0@lo:400:kworker.0 Request processed in 48us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841896.071938:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788841896.072274:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788841896.072307:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76866300 x1875736500676864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841896.072321:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76866300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500676864:0@lo:400:kworker.0 00000100:00100000:2.0:1788841896.072392:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76865500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500676480:0@lo:400:kworker.0 00000100:00100000:0.0:1788841896.072626:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875736500676736:0@lo:400:kworker.0 00000100:00100000:0.0:1788841896.072664:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841896.072768:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500676608:0@lo:400:kworker.0 00000100:00100000:2.0:1788841896.073839:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500676736 00000100:00100000:2.0:1788841896.073854:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500676736 00000100:00100000:2.0:1788841896.073912:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788841896.073921:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875736500676736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841896.074412:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841896.074532:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76865500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500677120:0@lo:400:kworker.0 00000100:00100000:3.0:1788841896.074580:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841896.074613:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500677120 00000100:00100000:3.0:1788841896.074617:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500677120 00000100:00100000:3.0:1788841896.074648:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788841896.074655:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500677120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841896.074773:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500677120:12345-0@lo:400:kworker.0 Request processed in 117us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841896.074780:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788841896.074801:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788841896.074806:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788841896.074813:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788841896.074822:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875736500676992:0@lo:400:kworker.0 00000100:00100000:3.0:1788841896.074849:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841896.074910:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500676608 00000100:00100000:3.0:1788841896.074914:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500676608 00000100:00100000:3.0:1788841896.074935:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500676992 00000100:00100000:3.0:1788841896.074939:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500676992 00000100:00100000:3.0:1788841896.075033:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788841896.075049:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500676608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841896.075083:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500676608:12345-0@lo:400:kworker.0 Request processed in 35us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841896.075099:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788841896.075113:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788841896.075118:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875736500676992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841896.075149:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875736500676992:12345-0@lo:400:kworker.0 Request processed in 30us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841896.075154:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1788841896.075171:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788841896.075199:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875736500676992:0@lo:400:kworker.0 00010000:00080000:3.0:1788841896.075229:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76865500 x1875736500677120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841896.075239:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76865500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500677120:0@lo:400:kworker.0 00000100:00100000:3.0:1788841896.075249:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500676608:0@lo:400:kworker.0 00000100:00100000:2.0:1788841896.075696:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875736500676736:12345-0@lo:400:kworker.0 Request processed in 1775us (3029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841896.075704:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788841896.081673:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875736500676736:0@lo:400:kworker.0 00000100:00100000:3.0:1788841896.582921:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500677248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788841896.583023:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841896.583177:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500677248 00000100:00100000:2.0:1788841896.583188:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500677248 00000100:00100000:2.0:1788841896.583258:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788841896.583270:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500677248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788841896.583320:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788841896.583381:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500677248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841896.583389:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788841896.584940:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a761bd500 x1875736500677248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841896.584972:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500677248:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788841896.835766:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841897.858149:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841897.903820:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841897.903866:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489108352 00000100:00100000:0.0:1788841897.903877:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489108352 00000100:00100000:0.0:1788841897.903947:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 61 00000100:00100000:0.0:1788841897.903957:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2351:x1875736489108352:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788841897.904042:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2351:x1875736489108352:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 86us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841897.904074:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 61 00000100:00080000:0.0:1788841897.904096:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788841897.904132:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841897.904190:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489108224 00000100:00100000:0.0:1788841897.904195:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489108224 00000100:00100000:0.0:1788841897.904288:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 206 00000100:00100000:0.0:1788841897.904296:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+10:2351:x1875736489108224:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788841897.904329:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+10:2351:x1875736489108224:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 35us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841897.904335:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 206 00000100:00100000:1.0:1788841898.628868:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788841898.628896:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500677376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788841898.629024:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841898.629109:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500677376 00000100:00100000:1.0:1788841898.629118:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500677376 00000100:00100000:1.0:1788841898.629170:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788841898.629178:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76866300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500677376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788841898.629211:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788841898.629256:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76866300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500677376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841898.629264:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788841898.629285:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788841898.629532:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76864e00 x1875736500677376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841898.629550:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500677376:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788841898.884442:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841899.908858:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841900.929883:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841901.186097:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500677632:0@lo:400:kworker.0 00000100:00100000:3.0:1788841901.186239:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841901.186342:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500677632 00000100:00100000:3.0:1788841901.186350:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500677632 00000100:00100000:3.0:1788841901.186403:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788841901.186428:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500677632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841901.186479:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500677632:12345-0@lo:400:kworker.0 Request processed in 69us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841901.186487:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788841901.186533:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500677632:0@lo:400:kworker.0 00000100:00100000:0.0:1788841901.186827:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875736500677760:0@lo:400:kworker.0 00000100:00100000:0.0:1788841901.186869:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841901.186920:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788841901.186926:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500678144:0@lo:400:kworker.0 00000100:00100000:0.0:1788841901.186954:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841901.187243:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500677760 00000100:00100000:0.0:1788841901.187248:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500677760 00000100:00100000:0.0:1788841901.187405:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788841901.187507:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500677888:0@lo:400:kworker.0 00000100:00100000:2.0:1788841901.187542:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841901.187589:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788841901.187597:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500677504:0@lo:400:kworker.0 00000100:00100000:2.0:1788841901.187627:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841901.187649:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875736500678016:0@lo:400:kworker.0 00000100:00100000:2.0:1788841901.187670:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841901.187737:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500678016 00000100:00100000:2.0:1788841901.187740:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500678016 00000100:00100000:2.0:1788841901.187765:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788841901.187772:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875736500678016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841901.187813:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875736500678016:12345-0@lo:400:kworker.0 Request processed in 41us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841901.187831:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1788841901.187864:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788841901.187877:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500678144 00000100:00100000:2.0:1788841901.187880:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500678144 00000100:00100000:2.0:1788841901.187905:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500677888 00000100:00100000:2.0:1788841901.187907:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500677888 00000100:00100000:2.0:1788841901.187925:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788841901.187931:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500678144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841901.187966:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500678144:12345-0@lo:400:kworker.0 Request processed in 35us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841901.187971:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788841901.188126:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875736500677760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841901.188163:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875736500677760:12345-0@lo:400:kworker.0 Request processed in 41us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841901.188169:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788841901.188191:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788841901.188198:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500677888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841901.188227:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500677888:12345-0@lo:400:kworker.0 Request processed in 30us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841901.188240:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788841901.188322:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500677504 00000100:00100000:1.0:1788841901.188327:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500677504 00000100:00100000:1.0:1788841901.188354:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788841901.188360:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3307:x1875736500677504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841901.188394:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3307:x1875736500677504:12345-0@lo:400:kworker.0 Request processed in 34us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841901.188400:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:2.0:1788841901.188572:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788841901.188576:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788841901.188600:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500677504:0@lo:400:kworker.0 00000100:00100000:2.0:1788841901.188613:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875736500678016:0@lo:400:kworker.0 00010000:00080000:2.0:1788841901.188625:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7616c700 x1875736500677888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841901.188635:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500677888:0@lo:400:kworker.0 00010000:00080000:2.0:1788841901.188686:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7616e680 x1875736500678144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841901.188694:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500678144:0@lo:400:kworker.0 00000100:00100000:2.0:1788841901.188704:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875736500677760:0@lo:400:kworker.0 00000100:00100000:3.0:1788841901.698050:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788841901.698075:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500678272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788841901.698156:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841901.698390:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500678272 00000100:00100000:1.0:1788841901.698400:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500678272 00000100:00100000:1.0:1788841901.698457:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788841901.698468:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500678272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788841901.698503:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788841901.698563:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500678272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841901.698570:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1788841901.698652:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a761bfb80 x1875736500678272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841901.698671:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500678272:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788841901.954010:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841902.977985:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841903.015140:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841903.015404:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489108480 00000100:00100000:1.0:1788841903.015416:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489108480 00000100:00100000:1.0:1788841903.016080:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 208 00000100:00100000:1.0:1788841903.016096:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+10:2350:x1875736489108480:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788841903.016183:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+10:2350:x1875736489108480:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 92us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841903.016190:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 208 00000100:00100000:3.0:1788841903.021288:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841903.021330:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489108608 00000100:00100000:3.0:1788841903.021340:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489108608 00000100:00100000:3.0:1788841903.021407:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 65 00000100:00100000:3.0:1788841903.021418:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2349:x1875736489108608:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841903.021502:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2349:x1875736489108608:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 86us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841903.021509:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 65 00000100:00080000:3.0:1788841903.021532:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1788841903.198828:0:10115:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 00:31:40 (1788841900) === 00000100:00100000:3.0:1788841903.483372:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841903.485346:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489108736 00000100:00100000:1.0:1788841903.485360:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489108736 00000100:00100000:1.0:1788841903.485480:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 209 00000100:00100000:1.0:1788841903.485492:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+10:8143:x1875736489108736:12345-192.168.204.55@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788841903.485527:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841903.485546:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a43531a00/0x3de1064d33a8b17b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef206b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841903.485575:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a43531a00/0x3de1064d33a8b17b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef206b expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841903.485587:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a43531a00/0x3de1064d33a8b17b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef206b expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841903.485596:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43531a00, rc 0) 00000100:00100000:1.0:1788841903.485674:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+11:8143:x1875736489108736:12345-192.168.204.55@tcp:101:mount.lustre.0 Request processed in 184us (2313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841903.485681:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 209 00000100:00100000:3.0:1788841903.491432:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841903.491978:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489108864 00000100:00100000:1.0:1788841903.491989:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489108864 00000100:00100000:1.0:1788841903.492101:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 210 00000100:00100000:1.0:1788841903.492112:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+11:8143:x1875736489108864:12345-192.168.204.55@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788841903.492452:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+11:8143:x1875736489108864:12345-192.168.204.55@tcp:501:mount.lustre.0 Request processed in 340us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841903.492460:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 210 00000100:00100000:3.0:1788841903.494067:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841903.497897:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489108992 00000100:00100000:0.0:1788841903.497920:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489108992 00000100:00100000:0.0:1788841903.498001:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 211 00000100:00100000:0.0:1788841903.498019:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+11:8143:x1875736489108992:12345-192.168.204.55@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788841903.498349:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+11:8143:x1875736489108992:12345-192.168.204.55@tcp:503:mount.lustre.0 Request processed in 332us (4295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841903.498357:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 211 00000100:00100000:3.0:1788841903.504187:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841903.504296:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489109120 00000100:00100000:0.0:1788841903.504307:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489109120 00000100:00100000:0.0:1788841903.504370:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 212 00000100:00100000:0.0:1788841903.504381:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+11:8147:x1875736489109120:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788841903.504672:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+11:8147:x1875736489109120:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 292us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841903.504682:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 212 00000100:00100000:3.0:1788841903.526019:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841903.526926:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489109248 00000100:00100000:1.0:1788841903.526955:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489109248 00000100:00100000:1.0:1788841903.527033:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 213 00000100:00100000:1.0:1788841903.527044:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+11:8147:x1875736489109248:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788841903.527372:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+11:8147:x1875736489109248:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 328us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841903.527386:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 213 00000100:00100000:3.0:1788841903.544565:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841903.546004:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489109376 00000100:00100000:2.0:1788841903.546021:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489109376 00000100:00100000:2.0:1788841903.546117:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 214 00000100:00100000:2.0:1788841903.546129:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+11:8143:x1875736489109376:12345-192.168.204.55@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788841903.546150:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841903.546170:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c6ccc00/0x3de1064d33a8b182 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2095 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841903.546199:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c6ccc00/0x3de1064d33a8b182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2095 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841903.546209:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c6ccc00/0x3de1064d33a8b182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2095 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841903.546219:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6ccc00, rc 0) 00000100:00100000:2.0:1788841903.546291:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+12:8143:x1875736489109376:12345-192.168.204.55@tcp:101:mount.lustre.0 Request processed in 164us (1740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841903.546298:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 214 00000100:00100000:0.0:1788841903.566875:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841903.566996:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489109504 00000100:00100000:2.0:1788841903.567014:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489109504 00000100:00100000:2.0:1788841903.567140:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 215 00000100:00100000:2.0:1788841903.567157:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+12:8143:x1875736489109504:12345-192.168.204.55@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788841903.567192:0:5845:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788841903.567219:0:5845:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788841903.567223:0:5845:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788841903.567227:0:5845:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788841903.567229:0:5845:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788841903.572295:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+12:8143:x1875736489109504:12345-192.168.204.55@tcp:256:mount.lustre.0 Request processed in 5124us (5417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841903.572318:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 215 00000100:00100000:3.0:1788841903.575342:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841903.576378:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489109632 00000100:00100000:1.0:1788841903.576397:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489109632 00000100:00100000:1.0:1788841903.576479:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 216 00000100:00100000:1.0:1788841903.576490:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+12:8143:x1875736489109632:12345-192.168.204.55@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788841903.576507:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841903.576527:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a43530400/0x3de1064d33a8b189 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef209c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841903.576561:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a43530400/0x3de1064d33a8b189 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef209c expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841903.576573:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a43530400/0x3de1064d33a8b189 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef209c expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841903.576582:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43530400, rc 0) 00000100:00100000:1.0:1788841903.576661:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+13:8143:x1875736489109632:12345-192.168.204.55@tcp:101:mount.lustre.0 Request processed in 173us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841903.576668:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 216 00000100:00100000:0.0:1788841903.582460:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841903.583072:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489109760 00000100:00100000:2.0:1788841903.583089:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489109760 00000100:00100000:2.0:1788841903.583178:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 217 00000100:00100000:2.0:1788841903.583192:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:8143:x1875736489109760:12345-192.168.204.55@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788841903.583651:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:8143:x1875736489109760:12345-192.168.204.55@tcp:501:mount.lustre.0 Request processed in 459us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841903.583661:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 217 00000100:00100000:3.0:1788841903.585987:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841903.586209:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489109888 00000100:00100000:2.0:1788841903.586656:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489109888 00000100:00100000:2.0:1788841903.586830:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 218 00000100:00100000:2.0:1788841903.586844:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:8143:x1875736489109888:12345-192.168.204.55@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788841903.587192:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:8143:x1875736489109888:12345-192.168.204.55@tcp:503:mount.lustre.0 Request processed in 341us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841903.587202:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 218 00000100:00100000:3.0:1788841903.594056:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841903.594383:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489110016 00000100:00100000:1.0:1788841903.594398:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489110016 00000100:00100000:1.0:1788841903.594479:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 219 00000100:00100000:1.0:1788841903.594492:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+13:8151:x1875736489110016:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788841903.594891:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+13:8151:x1875736489110016:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 400us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841903.594900:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 219 00000100:00100000:3.0:1788841903.607690:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841903.608073:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489110144 00000100:00100000:2.0:1788841903.608087:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489110144 00000100:00100000:2.0:1788841903.608163:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 220 00000100:00100000:2.0:1788841903.608176:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:8151:x1875736489110144:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788841903.610143:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:8151:x1875736489110144:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 1953us (2550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841903.610167:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 220 00000100:00100000:3.0:1788841903.614765:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841903.614803:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841903.615060:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489110272 00000100:00100000:0.0:1788841903.615075:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489110272 00000100:00100000:0.0:1788841903.615139:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489110400 00000100:00100000:0.0:1788841903.615163:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489110400 00000100:00100000:0.0:1788841903.615229:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 66 00000100:00100000:0.0:1788841903.615242:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2352:x1875736489110400:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788841903.615342:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2352:x1875736489110400:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 103us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841903.615351:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 66 00000100:00100000:0.0:1788841903.615373:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:0.0:1788841903.615377:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2348:x1875736489110272:12345-192.168.204.55@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788841903.615407:0:8623:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 419331f1-87f8-40c5-a1c8-5f66078f5ec5@192.168.204.55@tcp t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:0.0:1788841903.615456:0:8623:0:(genops.c:1385:class_connect()) connect: client 419331f1-87f8-40c5-a1c8-5f66078f5ec5, cookie 0x3de1064d33a8b190 00000004:00100000:0.0:1788841903.615502:0:8623:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:0.0:1788841903.615918:0:8623:0:(import.c:65:import_set_state_nolock()) ffff8d3a75de4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788841903.616232:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419331f1-87f8-40c5-a1c8-5f66078f5ec5+6:2348:x1875736489110272:12345-192.168.204.55@tcp:38:mount.lustre.0 Request processed in 849us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841903.616241:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:3.0:1788841903.622550:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841903.622631:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489110528 00000100:00100000:2.0:1788841903.622644:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489110528 00000100:00100000:2.0:1788841903.622792:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:2.0:1788841903.622805:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+6:0:x1875736489110528:12345-192.168.204.55@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788841903.622879:0:5850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788841903.623075:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+6:0:x1875736489110528:12345-192.168.204.55@tcp:41:mount.lustre.0 Request processed in 271us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841903.623088:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:3.0:1788841903.625533:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00080000:0.0:1788841903.625743:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788841903.625750:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489110656 00000100:00100000:2.0:1788841903.625764:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489110656 00000100:00100000:2.0:1788841903.627413:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:2.0:1788841903.627441:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419331f1-87f8-40c5-a1c8-5f66078f5ec5+6:8143:x1875736489110656:12345-192.168.204.55@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788841903.627492:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788841903.627604:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419331f1-87f8-40c5-a1c8-5f66078f5ec5+6:8143:x1875736489110656:12345-192.168.204.55@tcp:41:mount.lustre.0 Request processed in 176us (2085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841903.627613:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:2.0:1788841903.640322:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841903.640499:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489110784 00000100:00100000:1.0:1788841903.640514:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489110784 00000100:00100000:1.0:1788841903.640616:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:1.0:1788841903.640630:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419331f1-87f8-40c5-a1c8-5f66078f5ec5+6:8143:x1875736489110784:12345-192.168.204.55@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788841903.641130:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419331f1-87f8-40c5-a1c8-5f66078f5ec5+6:8143:x1875736489110784:12345-192.168.204.55@tcp:40:mount.lustre.0 Request processed in 500us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841903.641140:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:3.0:1788841903.658078:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841903.658195:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841903.665199:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841903.668887:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489111168 00000100:00100000:1.0:1788841903.668920:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489111168 00000100:00100000:1.0:1788841903.669055:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 1 00000100:00100000:1.0:1788841903.669071:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+6:8143:x1875736489111168:12345-192.168.204.55@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788841903.669183:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788841903.669309:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+6:8143:x1875736489111168:12345-192.168.204.55@tcp:33:mount.lustre.0 Request processed in 240us (4124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841903.669318:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 1 00000100:00100000:2.0:1788841903.675802:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489110912 00000100:00100000:2.0:1788841903.675836:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489110912 00000100:00100000:2.0:1788841903.676012:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489111040 00000100:00100000:2.0:1788841903.676016:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489111040 00000100:00100000:2.0:1788841903.676058:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:2.0:1788841903.676070:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1875736489110912:12345-192.168.204.55@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788841903.676113:0:8622:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 419331f1-87f8-40c5-a1c8-5f66078f5ec5@192.168.204.55@tcp t0 exp 0000000000000000 cur 231 last 0 00000100:00100000:3.0:1788841903.676151:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:3.0:1788841903.676158:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1875736489111040:12345-192.168.204.55@tcp:8:mount.lustre.0 00000020:00000080:2.0:1788841903.676159:0:8622:0:(genops.c:1385:class_connect()) connect: client 419331f1-87f8-40c5-a1c8-5f66078f5ec5, cookie 0x3de1064d33a8b197 00010000:00080000:3.0:1788841903.676176:0:6693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 419331f1-87f8-40c5-a1c8-5f66078f5ec5@192.168.204.55@tcp t0 exp 0000000000000000 cur 231 last 0 00002000:00100000:2.0:1788841903.676176:0:8622:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 419331f1-87f8-40c5-a1c8-5f66078f5ec5/ffff8d3a77b09000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113972 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000020:00000080:3.0:1788841903.676204:0:6693:0:(genops.c:1385:class_connect()) connect: client 419331f1-87f8-40c5-a1c8-5f66078f5ec5, cookie 0x3de1064d33a8b19e 00002000:00100000:2.0:1788841903.676208:0:8622:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00100000:3.0:1788841903.676209:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 419331f1-87f8-40c5-a1c8-5f66078f5ec5/ffff8d3a486f1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113972 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788841903.676225:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:3.0:1788841903.676545:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788841903.676596:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8d3a486f5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788841903.676704:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+6:2348:x1875736489111040:12345-192.168.204.55@tcp:8:mount.lustre.0 Request processed in 544us (18507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841903.676743:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 13 00002000:00080000:2.0:1788841903.680570:0:8622:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788841903.680620:0:8622:0:(import.c:65:import_set_state_nolock()) ffff8d3a77b0c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788841903.680952:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419331f1-87f8-40c5-a1c8-5f66078f5ec5+6:2348:x1875736489110912:12345-192.168.204.55@tcp:8:mount.lustre.0 Request processed in 4869us (22878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841903.680966:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:3.0:1788841903.756841:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500678400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788841903.756985:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841903.757091:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500678400 00000100:00100000:3.0:1788841903.757102:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500678400 00000100:00100000:3.0:1788841903.757176:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788841903.757188:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500678400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788841903.757289:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788841903.757347:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500678400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841903.757355:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788841903.757414:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a761be680 x1875736500678400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841903.757438:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500678400:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788841903.758306:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1788841903.839187:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 419331f1-87f8-40c5-a1c8-5f66078f5ec5 00010000:00010000:3.0:1788841904.001967:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841905.030868:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841906.049938:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841906.307103:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500678656:0@lo:400:kworker.0 00000100:00100000:3.0:1788841906.307178:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841906.307310:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500679168:0@lo:400:kworker.0 00000100:00100000:3.0:1788841906.307337:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841906.307371:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788841906.307377:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500678784:0@lo:400:kworker.0 00000100:00100000:3.0:1788841906.307402:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841906.307450:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500679168 00000100:00100000:3.0:1788841906.307459:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500679168 00000100:00100000:3.0:1788841906.307520:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788841906.307530:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500679168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841906.307594:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500679168:12345-0@lo:400:kworker.0 Request processed in 65us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841906.307602:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788841906.307626:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500678656 00000100:00100000:3.0:1788841906.307630:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500678656 00000100:00100000:3.0:1788841906.307653:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500678784 00000100:00100000:3.0:1788841906.307656:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500678784 00000100:00100000:3.0:1788841906.307677:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788841906.307682:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500678656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841906.307749:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500678656:12345-0@lo:400:kworker.0 Request processed in 66us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841906.307755:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788841906.307768:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788841906.307774:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500678784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841906.307798:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500678784:12345-0@lo:400:kworker.0 Request processed in 24us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841906.307803:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1788841906.307817:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788841906.307822:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788841906.307853:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500678784:0@lo:400:kworker.0 00000100:00100000:3.0:1788841906.307863:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500678656:0@lo:400:kworker.0 00010000:00080000:3.0:1788841906.307875:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7c476300 x1875736500679168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841906.307884:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500679168:0@lo:400:kworker.0 00000100:00100000:2.0:1788841906.308131:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c474a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500678912:0@lo:400:kworker.0 00000100:00100000:2.0:1788841906.308165:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841906.308194:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788841906.308200:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500678528:0@lo:400:kworker.0 00000100:00100000:2.0:1788841906.308225:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841906.308247:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875736500679040:0@lo:400:kworker.0 00000100:00100000:2.0:1788841906.308268:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841906.308328:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500679040 00000100:00100000:2.0:1788841906.308333:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500679040 00000100:00100000:2.0:1788841906.308360:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788841906.308366:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875736500679040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841906.308403:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875736500679040:12345-0@lo:400:kworker.0 Request processed in 37us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841906.308409:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788841906.308438:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875736500679040:0@lo:400:kworker.0 00000100:00100000:0.0:1788841906.308518:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500678912 00000100:00100000:0.0:1788841906.308523:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500678912 00000100:00100000:0.0:1788841906.308569:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788841906.308576:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500678912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841906.308619:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500678912:12345-0@lo:400:kworker.0 Request processed in 44us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841906.308625:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788841906.308649:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7c474a80 x1875736500678912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841906.308673:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c474a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500678912:0@lo:400:kworker.0 00000100:00080000:3.0:1788841906.309268:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788841906.309278:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788841906.310970:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500678528 00000100:00100000:0.0:1788841906.310982:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500678528 00000100:00100000:0.0:1788841906.311039:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788841906.311050:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3307:x1875736500678528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841906.311139:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3307:x1875736500678528:12345-0@lo:400:kworker.0 Request processed in 91us (2912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841906.311147:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788841906.311198:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500678528:0@lo:400:kworker.0 00000100:00100000:3.0:1788841906.819446:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788841906.819469:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500679296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788841906.819548:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841906.819735:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500679296 00000100:00100000:1.0:1788841906.819742:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500679296 00000100:00100000:1.0:1788841906.819788:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788841906.819797:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c476300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500679296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788841906.819831:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788841906.819892:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c476300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500679296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841906.819899:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1788841906.819935:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76864e00 x1875736500679296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841906.819955:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500679296:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788841907.075954:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788841907.399573:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 419331f1-87f8-40c5-a1c8-5f66078f5ec5 00000001:00100000:1.0:1788841907.942743:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 419331f1-87f8-40c5-a1c8-5f66078f5ec5 00010000:00010000:3.0:1788841908.097989:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841908.866096:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500679424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788841908.866172:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841908.866783:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500679424 00000100:00100000:3.0:1788841908.866791:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500679424 00000100:00100000:3.0:1788841908.866866:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788841908.866876:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500679424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788841908.866910:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788841908.866965:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500679424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841908.866974:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1788841908.867015:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7c475500 x1875736500679424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841908.867034:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500679424:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788841908.867303:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788841909.122008:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841909.156788:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841909.156846:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841909.156877:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841909.156894:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841909.156917:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841909.156941:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489111552 00000100:00100000:2.0:1788841909.156960:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489111552 00000100:00100000:2.0:1788841909.157012:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489111424 00000100:00100000:2.0:1788841909.157015:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489111424 00000100:00100000:2.0:1788841909.157034:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 70 00000100:00100000:2.0:1788841909.157043:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489111552:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788841909.157129:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489111552:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 86us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841909.157137:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 70 00000100:00100000:2.0:1788841909.157166:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 71 00000100:00100000:2.0:1788841909.157175:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2350:x1875736489111424:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788841909.157201:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2350:x1875736489111424:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 29us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841909.157207:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 71 00000100:00080000:2.0:1788841909.157223:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788841909.157385:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489111296 00000100:00100000:3.0:1788841909.157391:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489111296 00000100:00100000:3.0:1788841909.157435:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 222 00000100:00100000:3.0:1788841909.157444:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2350:x1875736489111296:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841909.157477:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2350:x1875736489111296:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 35us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841909.157483:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 222 00000100:00100000:3.0:1788841909.157513:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489111808 00000100:00100000:3.0:1788841909.157523:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489111808 00000100:00100000:3.0:1788841909.157555:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489111680 00000100:00100000:3.0:1788841909.157558:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489111680 00000100:00100000:3.0:1788841909.157580:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 38 00000100:00100000:3.0:1788841909.157587:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489111808:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841909.157615:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489111808:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 29us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841909.157622:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 38 00000100:00100000:3.0:1788841909.157634:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 39 00000100:00100000:3.0:1788841909.157640:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489111680:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841909.157662:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489111680:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 22us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841909.157668:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 39 00000100:00080000:3.0:1788841909.157855:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788841909.157858:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:1.0:1788841909.847085:0:10312:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1788841910.146147:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841911.170151:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841911.426156:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500679680:0@lo:400:kworker.0 00000100:00100000:3.0:1788841911.426250:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841911.426313:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500680192:0@lo:400:kworker.0 00000100:00100000:3.0:1788841911.426339:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841911.426370:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788841911.426376:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500679808:0@lo:400:kworker.0 00000100:00100000:3.0:1788841911.426419:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841911.426468:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500679680 00000100:00100000:3.0:1788841911.426478:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500679680 00000100:00100000:3.0:1788841911.426521:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500679808 00000100:00100000:3.0:1788841911.426524:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500679808 00000100:00100000:3.0:1788841911.426566:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788841911.426575:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500679680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841911.426625:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500679680:12345-0@lo:400:kworker.0 Request processed in 52us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841911.426632:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788841911.426654:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788841911.426661:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7681bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500679808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841911.426689:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7681bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500679808:12345-0@lo:400:kworker.0 Request processed in 29us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841911.426695:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788841911.426736:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500680192 00000100:00100000:3.0:1788841911.426740:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500680192 00000100:00100000:3.0:1788841911.426766:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788841911.426772:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c477b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500680192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841911.426814:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c477b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500680192:12345-0@lo:400:kworker.0 Request processed in 43us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841911.426821:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1788841911.426843:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788841911.426847:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788841911.426880:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500679808:0@lo:400:kworker.0 00000100:00100000:3.0:1788841911.426891:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500679680:0@lo:400:kworker.0 00010000:00080000:3.0:1788841911.426901:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7c477800 x1875736500680192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841911.426911:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500680192:0@lo:400:kworker.0 00000100:00100000:0.0:1788841911.427067:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500679552:0@lo:400:kworker.0 00000100:00100000:0.0:1788841911.427103:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841911.427136:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500680064:0@lo:400:kworker.0 00000100:00100000:0.0:1788841911.427158:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841911.427177:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788841911.427183:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500679936:0@lo:400:kworker.0 00000100:00100000:0.0:1788841911.427203:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841911.427228:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500680064 00000100:00100000:0.0:1788841911.427232:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500680064 00000100:00100000:0.0:1788841911.427259:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788841911.427265:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500680064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841911.427299:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500680064:12345-0@lo:400:kworker.0 Request processed in 34us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841911.427313:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788841911.427341:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500680064:0@lo:400:kworker.0 00000100:00100000:3.0:1788841911.428629:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500679552 00000100:00100000:3.0:1788841911.428648:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500679552 00000100:00100000:3.0:1788841911.428687:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788841911.428694:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3308:x1875736500679552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841911.428772:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3308:x1875736500679552:12345-0@lo:400:kworker.0 Request processed in 78us (1668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841911.428779:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788841911.428821:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500679936 00000100:00100000:3.0:1788841911.428825:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500679936 00000100:00100000:3.0:1788841911.428849:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788841911.428855:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500679936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841911.428882:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500679936:12345-0@lo:400:kworker.0 Request processed in 28us (1679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841911.428887:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788841911.428902:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788841911.428905:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788841911.428930:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7c475880 x1875736500679936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841911.428942:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500679936:0@lo:400:kworker.0 00000100:00100000:3.0:1788841911.428951:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500679552:0@lo:400:kworker.0 00000100:00100000:0.0:1788841911.938128:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500680320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788841911.938209:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841911.938417:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500680320 00000100:00100000:2.0:1788841911.938425:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500680320 00000100:00100000:2.0:1788841911.938481:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788841911.938492:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500680320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788841911.938526:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788841911.938595:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500680320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841911.938603:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1788841911.938887:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a761bf100 x1875736500680320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841911.938911:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500680320:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788841912.194103:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841913.217980:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841913.994081:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500680448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788841913.994163:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841913.995381:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500680448 00000100:00100000:3.0:1788841913.995435:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500680448 00000100:00100000:3.0:1788841913.995500:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788841913.995512:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7681a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500680448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788841913.995558:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788841913.995627:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7681a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500680448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841913.995635:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788841913.995660:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788841913.995693:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76864e00 x1875736500680448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841913.995733:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500680448:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788841914.244273:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841914.276857:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841914.276962:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841914.277004:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841914.277045:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841914.277101:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489112320 00000100:00100000:0.0:1788841914.277112:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489112320 00000100:00100000:0.0:1788841914.277187:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 42 00000100:00100000:0.0:1788841914.277198:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7baee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489112320:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788841914.277282:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7baee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489112320:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 85us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841914.277290:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 42 00000100:00080000:0.0:1788841914.277550:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788841914.277592:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489111936 00000100:00100000:1.0:1788841914.277598:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489111936 00000100:00100000:1.0:1788841914.277652:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 224 00000100:00100000:1.0:1788841914.277661:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2350:x1875736489111936:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788841914.277699:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2350:x1875736489111936:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 40us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841914.277731:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 224 00000100:00100000:2.0:1788841914.281220:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489112064 00000100:00100000:2.0:1788841914.281239:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489112064 00000100:00100000:3.0:1788841914.281290:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841914.281336:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489112448 00000100:00100000:3.0:1788841914.281340:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489112448 00000100:00100000:3.0:1788841914.281374:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 43 00000100:00100000:3.0:1788841914.281384:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76819c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489112448:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841914.281452:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76819c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489112448:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 69us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841914.281460:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 43 00000100:00080000:1.0:1788841914.281899:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788841914.281904:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788841914.282745:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489112192 00000100:00100000:2.0:1788841914.282754:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 75 00000100:00100000:0.0:1788841914.282755:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489112192 00000100:00080000:1.0:1788841914.282831:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788841914.282964:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7681a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2350:x1875736489112064:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788841914.283027:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7681a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2350:x1875736489112064:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 69us (6179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841914.283555:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 75 00000100:00100000:2.0:1788841914.283582:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 76 00000100:00100000:2.0:1788841914.283592:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489112192:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788841914.283639:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489112192:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 49us (6592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841914.283646:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 76 00010000:00010000:3.0:1788841915.270305:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841916.290907:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841916.548558:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76866a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500680576:0@lo:400:kworker.0 00000100:00100000:0.0:1788841916.548665:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841916.548932:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500680576 00000100:00100000:2.0:1788841916.548942:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500680576 00000100:00100000:2.0:1788841916.549003:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788841916.549015:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3308:x1875736500680576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841916.549139:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500680960:0@lo:400:kworker.0 00000100:00100000:3.0:1788841916.549180:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841916.549224:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500680704:0@lo:400:kworker.0 00000100:00100000:3.0:1788841916.549270:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841916.549292:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788841916.549298:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500680832:0@lo:400:kworker.0 00000100:00100000:3.0:1788841916.549320:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841916.549348:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500680704 00000100:00100000:3.0:1788841916.549352:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500680704 00000100:00100000:3.0:1788841916.549386:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500680832 00000100:00100000:3.0:1788841916.549389:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500680832 00000100:00100000:3.0:1788841916.549424:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788841916.549431:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500680704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841916.549474:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500680704:12345-0@lo:400:kworker.0 Request processed in 42us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841916.549481:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788841916.549502:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788841916.549508:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76819f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500680832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841916.549535:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76819f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500680832:12345-0@lo:400:kworker.0 Request processed in 28us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841916.549541:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1788841916.549568:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788841916.549607:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500680832:0@lo:400:kworker.0 00000100:00100000:3.0:1788841916.549618:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500680704:0@lo:400:kworker.0 00000100:00100000:3.0:1788841916.553122:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788841916.553152:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875736500681088:0@lo:400:kworker.0 00000100:00100000:3.0:1788841916.553245:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841916.553299:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76865500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500681216:0@lo:400:kworker.0 00000100:00100000:3.0:1788841916.553354:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841916.553398:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500680960 00000100:00100000:3.0:1788841916.553407:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500680960 00000100:00100000:3.0:1788841916.553465:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500681216 00000100:00100000:3.0:1788841916.553468:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500681216 00000100:00100000:3.0:1788841916.553491:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788841916.553499:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500680960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841916.553570:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500680960:12345-0@lo:400:kworker.0 Request processed in 71us (4388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841916.553578:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788841916.553597:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788841916.553603:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7681b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500681216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841916.553638:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7681b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500681216:12345-0@lo:400:kworker.0 Request processed in 35us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841916.553645:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788841916.553663:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788841916.553667:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788841916.553747:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76865500 x1875736500681216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841916.553765:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76865500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500681216:0@lo:400:kworker.0 00010000:00080000:3.0:1788841916.553801:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76864e00 x1875736500680960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841916.553810:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500680960:0@lo:400:kworker.0 00000100:00100000:2.0:1788841916.554041:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3308:x1875736500680576:12345-0@lo:400:kworker.0 Request processed in 5025us (5373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841916.554051:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788841916.554099:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500681088 00000100:00100000:2.0:1788841916.554104:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500681088 00000100:00100000:2.0:1788841916.554189:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788841916.554196:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875736500681088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841916.554240:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875736500681088:12345-0@lo:400:kworker.0 Request processed in 44us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841916.554247:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788841916.554277:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875736500681088:0@lo:400:kworker.0 00000100:00080000:3.0:1788841916.554363:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788841916.554586:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76866a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500680576:0@lo:400:kworker.0 00000100:00100000:2.0:1788841917.061572:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788841917.061606:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500681344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788841917.061693:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841917.061786:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500681344 00000100:00100000:2.0:1788841917.061794:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500681344 00000100:00100000:2.0:1788841917.061921:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788841917.061932:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500681344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788841917.061970:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788841917.062015:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500681344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841917.062023:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788841917.062060:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a761bc700 x1875736500681344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841917.062079:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500681344:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788841917.313863:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841918.338231:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841919.105977:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500681472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788841919.106045:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841919.106168:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500681472 00000100:00100000:1.0:1788841919.106178:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500681472 00000100:00100000:1.0:1788841919.106251:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788841919.106262:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500681472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788841919.106300:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788841919.106355:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500681472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841919.106363:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788841919.106426:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788841919.106453:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76865f80 x1875736500681472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841919.106471:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500681472:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788841919.364076:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841919.397073:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841919.397138:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841919.397180:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841919.397203:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841919.397223:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841919.397248:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489112576 00000100:00100000:3.0:1788841919.397258:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489112576 00000100:00100000:3.0:1788841919.397303:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 226 00000100:00100000:3.0:1788841919.397313:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2351:x1875736489112576:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841919.397379:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2351:x1875736489112576:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 68us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841919.397386:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 226 00000100:00100000:3.0:1788841919.397415:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489112704 00000100:00100000:3.0:1788841919.397419:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489112704 00000100:00100000:3.0:1788841919.397450:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489112832 00000100:00100000:3.0:1788841919.397453:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489112832 00000100:00100000:3.0:1788841919.397472:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 80 00000100:00100000:3.0:1788841919.397477:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7681ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2351:x1875736489112704:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841919.397504:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7681ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2351:x1875736489112704:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 27us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841919.397510:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 80 00000100:00100000:3.0:1788841919.397520:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 81 00000100:00100000:3.0:1788841919.397526:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7681aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2351:x1875736489112832:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841919.397546:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7681aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2351:x1875736489112832:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 20us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841919.397551:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 81 00000100:00100000:3.0:1788841919.397566:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489112960 00000100:00100000:3.0:1788841919.397574:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489112960 00000100:00100000:3.0:1788841919.397596:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489113088 00000100:00100000:3.0:1788841919.397598:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489113088 00000100:00100000:3.0:1788841919.397613:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 46 00000100:00100000:3.0:1788841919.397619:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2351:x1875736489112960:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841919.397666:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2351:x1875736489112960:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 46us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841919.397672:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 46 00000100:00100000:3.0:1788841919.397684:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 47 00000100:00100000:3.0:1788841919.397690:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76819180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2351:x1875736489113088:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841919.397736:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76819180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2351:x1875736489113088:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 46us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841919.397743:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 47 00000100:00080000:0.0:1788841919.398271:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788841919.398277:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788841919.398280:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788841920.385988:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841921.415002:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841921.666114:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7681b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875736500681856:0@lo:400:kworker.0 00000100:00100000:3.0:1788841921.666183:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841921.666262:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788841921.666269:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875736500681728:0@lo:400:kworker.0 00000100:00100000:1.0:1788841921.666323:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500681984:0@lo:400:kworker.0 00000100:00100000:1.0:1788841921.666355:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841921.666382:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788841921.666387:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7681b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500681600:0@lo:400:kworker.0 00000100:00100000:1.0:1788841921.666428:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841921.666455:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875736500682112:0@lo:400:kworker.0 00000100:00100000:1.0:1788841921.666496:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841921.666529:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500681984 00000100:00100000:1.0:1788841921.666537:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500681984 00000100:00100000:1.0:1788841921.666604:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788841921.666617:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500681984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841921.666673:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500681984:12345-0@lo:400:kworker.0 Request processed in 61us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841921.666681:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788841921.666705:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500681600 00000100:00100000:1.0:1788841921.666730:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500681600 00000100:00080000:2.0:1788841921.667127:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788841921.667141:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500681856 00000100:00100000:2.0:1788841921.667145:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500681856 00000100:00100000:2.0:1788841921.667179:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500682112 00000100:00100000:2.0:1788841921.667182:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500682112 00000100:00100000:2.0:1788841921.667204:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788841921.667212:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875736500681856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841921.667253:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875736500681856:12345-0@lo:400:kworker.0 Request processed in 43us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841921.667259:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788841921.667272:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788841921.667277:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875736500682112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841921.667302:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875736500682112:12345-0@lo:400:kworker.0 Request processed in 25us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841921.667318:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1788841921.667337:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788841921.667541:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841921.667628:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788841921.667638:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3307:x1875736500681600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841921.667671:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3307:x1875736500681600:12345-0@lo:400:kworker.0 Request processed in 37us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841921.667678:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788841921.667741:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500681728 00000100:00100000:2.0:1788841921.667746:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500681728 00000100:00100000:2.0:1788841921.667790:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788841921.667797:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875736500681728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841921.667830:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875736500681728:12345-0@lo:400:kworker.0 Request processed in 33us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841921.667835:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788841921.667875:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875736500681728:0@lo:400:kworker.0 00000100:00100000:2.0:1788841921.667884:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500682240:0@lo:400:kworker.0 00000100:00100000:2.0:1788841921.667911:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841921.667939:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7681b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875736500681856:0@lo:400:kworker.0 00000100:00100000:0.0:1788841921.668503:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7681b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500681600:0@lo:400:kworker.0 00000100:00100000:0.0:1788841921.668517:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875736500682112:0@lo:400:kworker.0 00010000:00080000:0.0:1788841921.668532:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76818a80 x1875736500681984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841921.668544:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500681984:0@lo:400:kworker.0 00000100:00100000:0.0:1788841921.668599:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500682240 00000100:00100000:0.0:1788841921.668603:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500682240 00000100:00100000:0.0:1788841921.668645:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788841921.668652:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500682240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841921.668699:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500682240:12345-0@lo:400:kworker.0 Request processed in 48us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841921.668705:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1788841921.673762:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788841921.673827:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7c476d80 x1875736500682240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841921.673842:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500682240:0@lo:400:kworker.0 00000100:00100000:1.0:1788841922.184650:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788841922.184684:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500682368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788841922.184796:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841922.185064:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500682368 00000100:00100000:3.0:1788841922.185074:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500682368 00000100:00100000:3.0:1788841922.185129:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788841922.185140:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76867b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500682368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788841922.185180:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788841922.185645:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76867b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500682368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 506us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841922.185670:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1788841922.193431:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7c475500 x1875736500682368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841922.193457:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500682368:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788841922.440385:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841923.459589:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841924.226316:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788841924.226350:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500682496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788841924.226432:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841924.228975:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500682496 00000100:00100000:1.0:1788841924.229000:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500682496 00000100:00100000:1.0:1788841924.229139:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788841924.229155:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500682496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788841924.229210:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788841924.229355:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500682496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 203us (2922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841924.229363:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788841924.229430:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76864e00 x1875736500682496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841924.229456:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500682496:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788841924.232833:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788841924.481999:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841924.517945:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841924.518003:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841924.518031:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841924.518069:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841924.518106:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841924.518145:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489113600 00000100:00100000:3.0:1788841924.518158:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489113600 00000100:00100000:3.0:1788841924.518234:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489113728 00000100:00100000:3.0:1788841924.518238:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489113728 00000100:00100000:3.0:1788841924.518269:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 14 00000100:00100000:3.0:1788841924.518282:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2348:x1875736489113600:12345-192.168.204.55@tcp:9:kworker.0 00000020:00000080:3.0:1788841924.518330:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8b197 00000100:00080000:3.0:1788841924.518342:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8d3a77b0c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788841924.518399:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788841924.519748:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489113472 00000100:00100000:1.0:1788841924.519765:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489113472 00000100:00100000:1.0:1788841924.519843:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489113344 00000100:00100000:1.0:1788841924.519847:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489113344 00000100:00100000:1.0:1788841924.519894:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 85 00000100:00100000:1.0:1788841924.519907:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489113472:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788841924.520032:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489113472:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 128us (2027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841924.520040:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 85 00000100:00100000:1.0:1788841924.520062:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 86 00000100:00100000:1.0:1788841924.520069:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2350:x1875736489113344:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788841924.520096:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2350:x1875736489113344:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 28us (2065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841924.520101:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 86 00000100:00100000:1.0:1788841924.520166:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00100000:1.0:1788841924.520175:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2348:x1875736489113728:12345-192.168.204.55@tcp:9:kworker.0 00000020:00000080:1.0:1788841924.520201:0:8622:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8b19e 00000100:00080000:1.0:1788841924.520214:0:8622:0:(import.c:65:import_set_state_nolock()) ffff8d3a486f5800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788841924.520263:0:8622:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788841924.520652:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:419331f1-87f8-40c5-a1c8-5f66078f5ec5+2:2348:x1875736489113728:12345-192.168.204.55@tcp:9:kworker.0 Request processed in 477us (2543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841924.520660:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00080000:1.0:1788841924.520688:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788841924.520693:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788841924.520696:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788841924.520739:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841924.520760:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841924.521195:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489113216 00000100:00100000:2.0:1788841924.521204:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489113216 00000100:00100000:2.0:1788841924.521267:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 228 00000100:00100000:2.0:1788841924.521278:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2350:x1875736489113216:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788841924.521326:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2350:x1875736489113216:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 51us (3398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841924.521334:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 228 00000100:00100000:1.0:1788841924.533978:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:419331f1-87f8-40c5-a1c8-5f66078f5ec5+2:2348:x1875736489113600:12345-192.168.204.55@tcp:9:kworker.0 Request processed in 15683us (15893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841924.533994:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 14 00010000:00010000:2.0:1788841925.506142:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841926.531702:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841926.793522:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500683008:0@lo:400:kworker.0 00000100:00100000:0.0:1788841926.793603:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841926.793671:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788841926.793678:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500682624:0@lo:400:kworker.0 00000100:00100000:0.0:1788841926.793739:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841926.793779:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875736500683136:0@lo:400:kworker.0 00000100:00100000:0.0:1788841926.793809:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841926.793840:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875736500682880:0@lo:400:kworker.0 00000100:00100000:0.0:1788841926.793868:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841926.793889:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788841926.793894:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875736500682752:0@lo:400:kworker.0 00000100:00100000:0.0:1788841926.793919:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841926.793936:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500683264:0@lo:400:kworker.0 00000100:00100000:0.0:1788841926.793956:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841926.793985:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500683136 00000100:00100000:0.0:1788841926.793993:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500683136 00000100:00100000:0.0:1788841926.794043:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500682880 00000100:00100000:0.0:1788841926.794046:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500682880 00000100:00100000:0.0:1788841926.794069:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500682752 00000100:00100000:0.0:1788841926.794071:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500682752 00000100:00100000:0.0:1788841926.794089:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788841926.794100:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875736500683136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841926.794163:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875736500683136:12345-0@lo:400:kworker.0 Request processed in 65us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841926.794170:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788841926.794189:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788841926.794196:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875736500682880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841926.794228:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875736500682880:12345-0@lo:400:kworker.0 Request processed in 33us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841926.794234:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788841926.794254:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788841926.794260:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875736500682752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841926.794292:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875736500682752:12345-0@lo:400:kworker.0 Request processed in 32us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841926.794298:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788841926.794341:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875736500682752:0@lo:400:kworker.0 00000100:00100000:0.0:1788841926.794355:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875736500682880:0@lo:400:kworker.0 00000100:00100000:0.0:1788841926.794390:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875736500683136:0@lo:400:kworker.0 00000100:00100000:0.0:1788841926.796644:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500683008 00000100:00100000:0.0:1788841926.796661:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500683008 00000100:00100000:0.0:1788841926.796738:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500683264 00000100:00100000:0.0:1788841926.796742:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500683264 00000100:00100000:0.0:1788841926.796782:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788841926.796792:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500683008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841926.796875:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500683008:12345-0@lo:400:kworker.0 Request processed in 85us (3272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841926.796883:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788841926.796901:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788841926.796908:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500683264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841926.796944:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500683264:12345-0@lo:400:kworker.0 Request processed in 36us (2986us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841926.796950:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1788841926.797001:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7616e680 x1875736500683264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841926.797016:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500683264:0@lo:400:kworker.0 00010000:00080000:0.0:1788841926.797066:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7616d500 x1875736500683008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841926.797076:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500683008:0@lo:400:kworker.0 00000100:00100000:1.0:1788841926.797287:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500682624 00000100:00100000:1.0:1788841926.797293:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500682624 00000100:00100000:1.0:1788841926.797331:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788841926.797339:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3307:x1875736500682624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841926.797382:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3307:x1875736500682624:12345-0@lo:400:kworker.0 Request processed in 44us (3642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841926.797388:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00080000:1.0:1788841926.799983:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788841926.799993:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788841926.799996:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788841926.800165:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500682624:0@lo:400:kworker.0 00000100:00100000:1.0:1788841927.299384:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500683392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788841927.299459:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841927.299967:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500683392 00000100:00100000:3.0:1788841927.299976:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500683392 00000100:00100000:3.0:1788841927.300032:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788841927.300042:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76864e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500683392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788841927.300079:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788841927.300156:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76864e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500683392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841927.300163:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788841927.300281:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7c474000 x1875736500683392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841943 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841927.300301:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500683392:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788841927.553857:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788841928.139383:0:11012:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1788841928.401149:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 419331f1-87f8-40c5-a1c8-5f66078f5ec5 00000020:00000080:1.0:1788841928.401159:0:7641:0:(genops.c:885:class_export_put()) final put ffff8d3a486f1800/419331f1-87f8-40c5-a1c8-5f66078f5ec5 00000020:00000080:1.0:1788841928.401190:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a486f1800/419331f1-87f8-40c5-a1c8-5f66078f5ec5 for lustre-OST0001 00000020:00000080:1.0:1788841928.401230:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3a486f5800 for lustre-OST0001 00010000:00010000:1.0:1788841928.578182:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841929.351190:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788841929.351221:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500683520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788841929.351299:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841929.352322:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500683520 00000100:00100000:2.0:1788841929.352333:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500683520 00000100:00100000:2.0:1788841929.352394:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788841929.352404:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500683520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788841929.352437:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788841929.352510:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500683520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841929.352518:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1788841929.352539:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788841929.352572:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7c474000 x1875736500683520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841929.352595:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500683520:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788841929.468559:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 419331f1-87f8-40c5-a1c8-5f66078f5ec5 00000020:00000080:3.0:1788841929.468570:0:6720:0:(genops.c:885:class_export_put()) final put ffff8d3a77b09000/419331f1-87f8-40c5-a1c8-5f66078f5ec5 00000020:00000080:1.0:1788841929.468686:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a77b09000/419331f1-87f8-40c5-a1c8-5f66078f5ec5 for lustre-OST0000 00000020:00000080:1.0:1788841929.479211:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3a77b0c000 for lustre-OST0000 00010000:00010000:2.0:1788841929.609133:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841929.644011:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841929.644059:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841929.644085:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841929.644109:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489114112 00000100:00100000:0.0:1788841929.644119:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489114112 00000100:00100000:0.0:1788841929.644172:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489113984 00000100:00100000:0.0:1788841929.644176:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489113984 00000100:00100000:2.0:1788841929.644191:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489113856 00000100:00100000:2.0:1788841929.644198:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489113856 00000100:00100000:0.0:1788841929.644208:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 90 00000100:00100000:0.0:1788841929.644220:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2349:x1875736489114112:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788841929.644238:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 230 00000100:00100000:2.0:1788841929.644248:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2349:x1875736489113856:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788841929.644838:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2349:x1875736489114112:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 618us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841929.644848:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 90 00000100:00100000:0.0:1788841929.644868:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 91 00000100:00100000:0.0:1788841929.644877:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2349:x1875736489113984:12345-192.168.204.55@tcp:400:kworker.0 00000100:00080000:1.0:1788841929.653359:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788841929.654991:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2349:x1875736489113856:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 10730us (10975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841929.655017:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 230 00000100:00100000:0.0:1788841929.656907:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2349:x1875736489113984:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 12021us (12810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841929.656923:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 91 00010000:00010000:2.0:1788841930.633288:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841931.650193:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841931.906971:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4926dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500684032:0@lo:400:kworker.0 00000100:00100000:3.0:1788841931.907007:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76865500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500683648:0@lo:400:kworker.0 00000100:00100000:1.0:1788841931.907050:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841931.907051:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841931.907106:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500684032 00000100:00100000:0.0:1788841931.907115:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500684032 00000100:00100000:0.0:1788841931.907190:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788841931.907200:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500684032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841931.913132:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500684032:12345-0@lo:400:kworker.0 Request processed in 5923us (6070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841931.913148:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1788841931.913194:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788841931.913555:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4926c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500684160:0@lo:400:kworker.0 00000100:00100000:3.0:1788841931.913606:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841931.913705:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500683648 00000100:00100000:3.0:1788841931.913735:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500683648 00000100:00100000:3.0:1788841931.913777:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788841931.913785:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3308:x1875736500683648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841931.913836:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3308:x1875736500683648:12345-0@lo:400:kworker.0 Request processed in 51us (6784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841931.913842:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788841931.913890:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76865500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500683648:0@lo:400:kworker.0 00010000:00080000:1.0:1788841931.914159:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a4926dc00 x1875736500684032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841931.914173:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4926dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500684032:0@lo:400:kworker.0 00000100:00100000:1.0:1788841931.914198:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500683776:0@lo:400:kworker.0 00000100:00100000:1.0:1788841931.914227:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841931.914431:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4926d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500684288:0@lo:400:kworker.0 00000100:00100000:1.0:1788841931.914460:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841931.914482:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788841931.914488:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500683904:0@lo:400:kworker.0 00000100:00100000:1.0:1788841931.914509:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841931.914560:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500684160 00000100:00100000:0.0:1788841931.914565:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500684160 00000100:00100000:0.0:1788841931.914607:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500683776 00000100:00100000:0.0:1788841931.914611:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500683776 00000100:00100000:0.0:1788841931.914631:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788841931.914639:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500684160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841931.914685:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500684160:12345-0@lo:400:kworker.0 Request processed in 47us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841931.914692:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788841931.914705:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788841931.914727:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500683776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841931.914757:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500683776:12345-0@lo:400:kworker.0 Request processed in 30us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841931.914763:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:0.0:1788841931.914788:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788841931.914885:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500683776:0@lo:400:kworker.0 00000100:00100000:1.0:1788841931.914911:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500684288 00000100:00100000:1.0:1788841931.914914:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500684288 00000100:00100000:1.0:1788841931.915346:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788841931.915360:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500684288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841931.915421:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500684288:12345-0@lo:400:kworker.0 Request processed in 67us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841931.915428:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1788841931.915463:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a4926d880 x1875736500684288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841931.915473:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4926d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500684288:0@lo:400:kworker.0 00000100:00100000:0.0:1788841931.915548:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500683904 00000100:00100000:0.0:1788841931.915554:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500683904 00000100:00100000:0.0:1788841931.915582:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788841931.915589:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500683904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841931.915626:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500683904:12345-0@lo:400:kworker.0 Request processed in 37us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841931.915641:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1788841931.915656:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788841931.915660:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788841931.915739:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500683904:0@lo:400:kworker.0 00000100:00100000:3.0:1788841931.915926:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4926c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500684160:0@lo:400:kworker.0 00000020:00000080:0.0:1788841932.342845:0:11162:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee92a1ee0 20000000:00000080:0.0:1788841932.342880:0:11162:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d3a4eace000 uarg=0000000000000000 20000000:01000000:0.0:1788841932.342928:0:11162:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788841932.342935:0:11162:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788841932.342941:0:11162:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788841932.346822:0:11163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788841932.347522:0:11162:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788841932.359889:0:11162:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788841932.359931:0:11162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d3a43530800/0x3de1064d33a8b1a5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841932.359955:0:11162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8b151 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b14a expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841932.359963:0:11162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a7c78f000/0x3de1064d33a8b15f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b158 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841932.359970:0:11162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8b16d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b166 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841932.359981:0:11162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a43531400/0x3de1064d33a8b174 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2064 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841932.359988:0:11162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a43530400/0x3de1064d33a8b189 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef209c expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841932.360304:0:11162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d3a43530800/0x3de1064d33a8b1a5 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841932.360355:0:11162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a43530400/0x3de1064d33a8b189 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef209c expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841932.360373:0:11162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d3a43530400/0x3de1064d33a8b189 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef209c expref: 12 pid: 5842 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841932.360399:0:11162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4926d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1875736500684416:192.168.204.55@tcp:104: 00010000:00010000:1.0:1788841932.360607:0:11162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a43531400/0x3de1064d33a8b174 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2064 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841932.360616:0:11162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d3a43531400/0x3de1064d33a8b174 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2064 expref: 12 pid: 5842 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841932.360624:0:11162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4926ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1875736500684544:192.168.204.55@tcp:104: 00010000:00010000:1.0:1788841932.360662:0:11162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8b16d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8b166 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841932.360671:0:11162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8b16d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8b166 expref: 18 pid: 5844 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841932.360681:0:11162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4926c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1875736500684672:0@lo:104: 00000100:00100000:1.0:1788841932.360800:0:11162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788841932.360873:0:11162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a7c78f000/0x3de1064d33a8b15f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8b158 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841932.360893:0:11162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3a7c78f000/0x3de1064d33a8b15f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8b158 expref: 18 pid: 5842 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841932.360902:0:11162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4926d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1875736500684800:0@lo:104: 00000100:00100000:1.0:1788841932.360925:0:11162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788841932.362786:0:11162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8b151 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8b14a expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841932.362799:0:11162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8b151 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8b14a expref: 18 pid: 5845 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841932.362810:0:11162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4926d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1875736500684928:0@lo:104: 00000100:00100000:1.0:1788841932.362852:0:11162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841932.365209:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841932.365305:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841932.365338:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489114240 00000100:00100000:3.0:1788841932.365347:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489114240 00010000:00010000:3.0:1788841932.365412:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a43530400/0x3de1064d33a8b189 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef209c expref: 13 pid: 5842 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841932.365443:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489114368 00000100:00100000:3.0:1788841932.365446:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489114368 00010000:00010000:3.0:1788841932.365458:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a43531400/0x3de1064d33a8b174 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2064 expref: 14 pid: 5842 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841932.365479:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 25 00000100:00100000:3.0:1788841932.365488:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4ec1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51360ac4-5eeb-41b7-beab-1dfd58163005+14:2350:x1875736489114240:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788841932.365530:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841932.365536:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a43530400/0x3de1064d33a8b189 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef209c expref: 14 pid: 5842 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841932.365549:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a43530400/0x3de1064d33a8b189 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef209c expref: 14 pid: 5842 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841932.365571:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841932.365623:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4ec1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51360ac4-5eeb-41b7-beab-1dfd58163005+14:2350:x1875736489114240:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 136us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841932.365631:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 25 00000100:00100000:3.0:1788841932.365685:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 26 00000100:00100000:3.0:1788841932.365692:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c476d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2350:x1875736489114368:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788841932.365700:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841932.365704:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a43531400/0x3de1064d33a8b174 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2064 expref: 13 pid: 5842 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841932.365746:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a43531400/0x3de1064d33a8b174 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2064 expref: 13 pid: 5842 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841932.365756:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841932.365775:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c476d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2350:x1875736489114368:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 83us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841932.365782:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 26 00000100:00100000:2.0:1788841932.368263:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500684672 00000100:00100000:2.0:1788841932.368279:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500684672 00000100:00100000:3.0:1788841932.368536:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500684800 00000100:00100000:3.0:1788841932.368541:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500684800 00000100:00100000:3.0:1788841932.368563:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788841932.368573:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:fd738bcb-4fee-4a21-af92-bab36d5458e2+4:11162:x1875736500684672:12345-0@lo:104: 00010000:00010000:3.0:1788841932.368609:0:7630:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8b166 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8b16d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841932.368731:0:7630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788841932.368738:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:fd738bcb-4fee-4a21-af92-bab36d5458e2+4:11162:x1875736500684672:12345-0@lo:104: Request processed in 166us (7938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841932.368746:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1788841932.368770:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788841932.368777:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8b166 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8b16d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841932.368784:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052800 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:3.0:1788841932.368788:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8b166 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8b16d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841932.368796:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8b166 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8b16d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788841932.368803:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8b166 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8b16d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788841932.368808:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788841932.368850:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8b166 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b16d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841932.368857:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788841932.368879:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8b166 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b16d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841932.368886:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a60052800/0x3de1064d33a8b166 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b16d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841932.368909:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841932.368910:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841932.368912:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841932.368942:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500685056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788841932.368989:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841932.369047:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500685056 00000100:00100000:3.0:1788841932.369051:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500685056 00010000:00010000:3.0:1788841932.369069:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8b16d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8b166 expref: 19 pid: 5844 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841932.369090:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788841932.369096:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c474000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3310:x1875736500685056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788841932.369105:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841932.369109:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8b16d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8b166 expref: 19 pid: 5844 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841932.369118:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8b16d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8b166 expref: 19 pid: 5844 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841932.369148:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841932.369252:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c474000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3310:x1875736500685056:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841932.369259:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788841932.369296:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500685056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788841932.369317:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788841932.369324:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:fd738bcb-4fee-4a21-af92-bab36d5458e2+3:11162:x1875736500684800:12345-0@lo:104: 00010000:00010000:3.0:1788841932.369342:0:7630:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cde00/0x3de1064d33a8b158 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8b15f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841932.369376:0:7630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788841932.369381:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:fd738bcb-4fee-4a21-af92-bab36d5458e2+3:11162:x1875736500684800:12345-0@lo:104: Request processed in 58us (8455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841932.369397:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1788841932.369797:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788841932.369805:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cde00/0x3de1064d33a8b158 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8b15f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841932.369812:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cde00 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:2.0:1788841932.369816:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cde00/0x3de1064d33a8b158 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8b15f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841932.369823:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cde00/0x3de1064d33a8b158 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8b15f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788841932.369830:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cde00/0x3de1064d33a8b158 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8b15f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841932.369835:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788841932.369861:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cde00/0x3de1064d33a8b158 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b15f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841932.369867:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788841932.369884:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cde00/0x3de1064d33a8b158 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b15f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841932.369891:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cde00/0x3de1064d33a8b158 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b15f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841932.369914:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841932.369916:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841932.369918:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841932.369929:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500685184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788841932.369963:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841932.370000:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500685184 00000100:00100000:2.0:1788841932.370004:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500685184 00010000:00010000:2.0:1788841932.370025:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a7c78f000/0x3de1064d33a8b15f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8b158 expref: 19 pid: 5842 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841932.370046:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788841932.370052:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3307:x1875736500685184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788841932.370060:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788841932.370063:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a7c78f000/0x3de1064d33a8b15f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8b158 expref: 19 pid: 5842 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841932.370072:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a7c78f000/0x3de1064d33a8b15f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8b158 expref: 19 pid: 5842 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841932.370084:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788841932.370111:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3307:x1875736500685184:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841932.370127:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788841932.370154:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500685184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788841932.370813:0:11162:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a793b63c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788841932.370833:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a43530400/0x3de1064d33a8b189 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef209c expref: 12 pid: 5842 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841932.370845:0:11162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4926d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1875736500684416:192.168.204.55@tcp:104: 00010000:00010000:1.0:1788841932.370855:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a43531400/0x3de1064d33a8b174 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2064 expref: 11 pid: 5842 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841932.370862:0:11162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4926ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1875736500684544:192.168.204.55@tcp:104: 00010000:00010000:1.0:1788841932.370873:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8b16d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8b166 expref: 18 pid: 5844 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841932.370886:0:11162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4926c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1875736500684672:0@lo:104: 00010000:00010000:1.0:1788841932.370896:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a7c78f000/0x3de1064d33a8b15f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8b158 expref: 17 pid: 5842 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841932.370916:0:11162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4926d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1875736500684800:0@lo:104: 00000100:00100000:0.0:1788841932.371193:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500684928 00000100:00100000:0.0:1788841932.371199:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500684928 00000100:00100000:1.0:1788841932.381411:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788841932.381448:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+3:11162:x1875736500684928:12345-0@lo:104: 00010000:00010000:1.0:1788841932.381471:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a43531000/0x3de1064d33a8b14a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8b151 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841932.381601:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788841932.381618:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+3:11162:x1875736500684928:12345-0@lo:104: Request processed in 191us (18765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841932.381625:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788841932.381768:0:11162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4926d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1875736500684928:0@lo:104: 00010000:00010000:0.0:1788841932.381809:0:11162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d3a43530800/0x3de1064d33a8b1a5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841932.381845:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788841932.381853:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a43531000/0x3de1064d33a8b14a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8b151 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841932.381880:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43531000 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:2.0:1788841932.381885:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a43531000/0x3de1064d33a8b14a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8b151 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841932.381894:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a43531000/0x3de1064d33a8b14a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8b151 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788841932.381902:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a43531000/0x3de1064d33a8b14a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8b151 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841932.381907:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788841932.381980:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a43531000/0x3de1064d33a8b14a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b151 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841932.381986:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788841932.382015:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a43531000/0x3de1064d33a8b14a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b151 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841932.382022:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a43531000/0x3de1064d33a8b14a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b151 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841932.382036:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841932.382037:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841932.382039:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841932.382047:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788841932.382061:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500685312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788841932.382105:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841932.382160:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500685312 00000100:00100000:2.0:1788841932.382167:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500685312 00010000:00010000:2.0:1788841932.382315:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8b151 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8b14a expref: 17 pid: 5845 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841932.382349:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788841932.382355:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:3307:x1875736500685312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788841932.382367:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788841932.382372:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8b151 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8b14a expref: 17 pid: 5845 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841932.382392:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8b151 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8b14a expref: 17 pid: 5845 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841932.382409:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8b151 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8b14a expref: 17 pid: 5845 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841932.382426:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d3a43530800/0x3de1064d33a8b1a5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841932.382434:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a43530800/0x3de1064d33a8b1a5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841932.382451:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3a43530800/0x3de1064d33a8b1a5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841932.382457:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3a43530800/0x3de1064d33a8b1a5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841932.382464:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d3a43530800/0x3de1064d33a8b1a5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841932.382470:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d3a43530800/0x3de1064d33a8b1a5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841932.382486:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43530800 already unused, calling callback (ffffffffc1813420) 00010000:00010000:2.0:1788841932.382490:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d3a43530800/0x3de1064d33a8b1a5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841932.382498:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d3a43530800/0x3de1064d33a8b1a5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841932.382511:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d3a43530800/0x3de1064d33a8b1a5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841932.382588:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788841932.382639:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:3307:x1875736500685312:12345-0@lo:103:ldlm_bl.0 Request processed in 283us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841932.382646:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788841932.382677:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500685312:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788841932.382865:0:11162:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d3a43530800/0x3de1064d33a8b1a5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841932.382875:0:11162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d3a43530800/0x3de1064d33a8b1a5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841932.382880:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a43530800/0x3de1064d33a8b1a5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841932.419931:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788841932.419956:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500685440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788841932.420036:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841932.420090:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500685440 00000100:00100000:3.0:1788841932.420097:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500685440 00000100:00100000:3.0:1788841932.420160:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788841932.420169:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500685440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788841932.420206:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788841932.420265:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500685440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841932.420272:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788841932.420320:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7c474700 x1875736500685440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841948 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841932.420338:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500685440:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788841932.673779:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841933.476272:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841933.476690:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489114496 00000100:00100000:2.0:1788841933.476701:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489114496 00000100:00100000:2.0:1788841933.476788:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 232 00000100:00100000:2.0:1788841933.476800:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+11:5593:x1875736489114496:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788841933.476819:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841933.476841:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c6cde00/0x3de1064d33a8b1ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef20c6 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841933.476869:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c6cde00/0x3de1064d33a8b1ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20c6 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841933.476880:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c6cde00/0x3de1064d33a8b1ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20c6 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841933.476902:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cde00, rc 0) 00000100:00100000:2.0:1788841933.476970:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+12:5593:x1875736489114496:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 Request processed in 172us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841933.476978:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 232 00000100:00100000:3.0:1788841933.482313:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841933.482807:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489114624 00000100:00100000:0.0:1788841933.482817:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489114624 00000100:00100000:0.0:1788841933.482880:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 233 00000100:00100000:0.0:1788841933.482892:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+12:5593:x1875736489114624:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788841933.483852:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+12:5593:x1875736489114624:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 Request processed in 957us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841933.483874:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 233 00000100:00100000:0.0:1788841933.496039:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841933.496165:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489114752 00000100:00100000:3.0:1788841933.496175:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489114752 00000100:00100000:3.0:1788841933.496247:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 234 00000100:00100000:3.0:1788841933.496257:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49926050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+12:5593:x1875736489114752:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788841933.496536:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49926050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+12:5593:x1875736489114752:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 Request processed in 280us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841933.496544:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 234 00000100:00100000:3.0:1788841933.523768:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841933.524342:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489114880 00000100:00100000:0.0:1788841933.524353:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489114880 00000100:00100000:0.0:1788841933.524423:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 235 00000100:00100000:0.0:1788841933.524433:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+12:5593:x1875736489114880:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788841933.524449:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841933.524467:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c78fc00/0x3de1064d33a8b1b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef20cd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841933.524504:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c78fc00/0x3de1064d33a8b1b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20cd expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841933.524515:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c78fc00/0x3de1064d33a8b1b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20cd expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841933.524534:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78fc00, rc 0) 00000100:00100000:0.0:1788841933.524606:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+13:5593:x1875736489114880:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 Request processed in 173us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841933.524613:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 235 00000100:00100000:1.0:1788841933.542681:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841933.542779:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489115008 00000100:00100000:2.0:1788841933.542790:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489115008 00000100:00100000:2.0:1788841933.542852:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 236 00000100:00100000:2.0:1788841933.542863:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49924850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:5593:x1875736489115008:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788841933.543159:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49924850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:5593:x1875736489115008:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 Request processed in 297us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841933.543168:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 236 00000100:00100000:1.0:1788841933.556138:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841933.556358:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489115136 00000100:00100000:3.0:1788841933.556383:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489115136 00000100:00100000:3.0:1788841933.556444:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 237 00000100:00100000:3.0:1788841933.556454:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:5593:x1875736489115136:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788841933.556766:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:5593:x1875736489115136:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 Request processed in 310us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841933.556774:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 237 00010000:00010000:3.0:1788841933.707283:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788841933.825873:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788841933.825881:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3944ec2800 from 7 10000000:01000000:0.0:1788841933.825885:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788841933.825947:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8b1ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841933.825960:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8b1ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841933.825988:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8b1ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841933.826014:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500685568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788841933.826083:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841933.826144:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7c7b8300 going to sleep for 11 seconds 00000100:00100000:3.0:1788841933.826236:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500685568 00000100:00100000:3.0:1788841933.826244:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500685568 00000100:00100000:3.0:1788841933.826299:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788841933.826309:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:5847:x1875736500685568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788841933.826323:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841933.826335:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8b1c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8b1ba expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841933.826378:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8b1c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8b1ba expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841933.826388:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8b1c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b1ba expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841933.826398:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60052000, rc 0) 00000100:00100000:3.0:1788841933.826460:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:5847:x1875736500685568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841933.826467:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788841933.826679:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500685568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788841933.826695:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8b1ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b1c1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841933.826703:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8b1ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b1c1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841933.826791:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4926ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500685696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788841933.826820:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841933.826838:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a793b6180 going to sleep for 11 seconds 00000100:00100000:3.0:1788841933.827254:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500685696 00000100:00100000:3.0:1788841933.827260:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500685696 00000100:00100000:3.0:1788841933.827287:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788841933.827294:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49926c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:5847:x1875736500685696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788841933.828792:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4926ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500685696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788841933.828838:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4926ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500685824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788841933.835005:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841933.835067:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a793b6180 going to sleep for 11 seconds 00000100:00100000:0.0:1788841933.835149:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500685824 00000100:00100000:0.0:1788841933.835159:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500685824 00000100:00100000:0.0:1788841933.835214:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788841933.835223:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500685824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788841933.835463:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500685824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 241us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841933.835472:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788841933.835529:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4926ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500685824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788841933.836194:0:11181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788841933.836247:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788841933.836262:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788841933.836274:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8b1ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b1c1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841933.836285:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8b1ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b1c1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841933.836296:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788841933.836298:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3a4e19d800 from 7 10000000:01000000:0.0:1788841933.836301:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788841933.836330:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f200/0x3de1064d33a8b1c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841933.836345:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f200/0x3de1064d33a8b1c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841933.836369:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f200/0x3de1064d33a8b1c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841933.836391:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500685952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788841933.836432:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841933.836450:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7c7b8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788841933.836464:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500685952 00000100:00100000:0.0:1788841933.836468:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500685952 00000100:00100000:0.0:1788841933.836490:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788841933.836497:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500685952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788841933.836506:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841933.836519:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c78e600/0x3de1064d33a8b1cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8b1c8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841933.836539:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c78e600/0x3de1064d33a8b1cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8b1c8 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841933.836550:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c78e600/0x3de1064d33a8b1cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b1c8 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841933.836558:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78e600, rc 0) 00000100:00100000:0.0:1788841933.836590:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:5847:x1875736500685952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841933.836597:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788841933.836640:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500685952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788841933.836652:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f200/0x3de1064d33a8b1c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b1cf expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841933.836661:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f200/0x3de1064d33a8b1c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b1cf expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841933.836701:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500686080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788841933.836748:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841933.836761:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7c7b8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788841933.836772:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500686080 00000100:00100000:0.0:1788841933.836775:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500686080 00000100:00100000:0.0:1788841933.836792:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788841933.836799:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:5847:x1875736500686080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788841933.837036:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:5847:x1875736500686080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841933.837042:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788841933.837071:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500686080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788841933.837096:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500686208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788841933.837131:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841933.837146:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7c7b8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788841933.837157:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500686208 00000100:00100000:0.0:1788841933.837160:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500686208 00000100:00100000:0.0:1788841933.837177:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788841933.837182:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49927850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:5847:x1875736500686208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788841933.837314:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49927850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:5847:x1875736500686208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841933.837325:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788841933.837373:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500686208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788841933.845807:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49926c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500685696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 18503us (18976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841933.845823:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000040:00080000:0.0:1788841933.849798:0:11182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788841933.849889:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788841933.849909:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788841933.849921:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f200/0x3de1064d33a8b1c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b1cf expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841933.849932:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f200/0x3de1064d33a8b1c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b1cf expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841933.849943:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788841933.849946:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3a43e8f800 from 7 10000000:01000000:0.0:1788841933.849949:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788841933.849990:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f000/0x3de1064d33a8b1d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841933.849999:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f000/0x3de1064d33a8b1d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841933.850176:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f000/0x3de1064d33a8b1d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841933.850205:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500686336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788841933.850276:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841933.850320:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7c7b89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841933.850345:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500686336 00000100:00100000:0.0:1788841933.850352:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500686336 00000100:00100000:0.0:1788841933.850407:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788841933.850428:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500686336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788841933.850441:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841933.850453:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c78ea00/0x3de1064d33a8b1dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8b1d6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841933.850475:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c78ea00/0x3de1064d33a8b1dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8b1d6 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841933.850485:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c78ea00/0x3de1064d33a8b1dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b1d6 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841933.850493:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78ea00, rc 0) 00000100:00100000:0.0:1788841933.850531:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:5847:x1875736500686336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841933.850538:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788841933.850584:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500686336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788841933.850598:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f000/0x3de1064d33a8b1d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b1dd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841933.850606:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f000/0x3de1064d33a8b1d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b1dd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841933.858324:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500686464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788841933.858432:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841933.858490:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7c7b89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841933.858523:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500686464 00000100:00100000:0.0:1788841933.858529:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500686464 00000100:00100000:0.0:1788841933.858574:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788841933.858600:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:5847:x1875736500686464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788841933.858919:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:5847:x1875736500686464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 318us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841933.858927:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788841933.858978:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500686464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788841933.859299:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500686592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788841933.859339:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841933.859784:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500686592 00000100:00100000:2.0:1788841933.859790:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500686592 00000100:00100000:2.0:1788841933.859824:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788841933.859832:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49924050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:5847:x1875736500686592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788841933.859994:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49924050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:5847:x1875736500686592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841933.860001:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788841933.860206:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7c7b89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841933.860224:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500686592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788841933.865864:0:11184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788841933.866225:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788841933.866247:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788841933.866260:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f000/0x3de1064d33a8b1d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b1dd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841933.866273:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f000/0x3de1064d33a8b1d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b1dd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841934.466128:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500686720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788841934.466205:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841934.466255:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500686720 00000100:00100000:0.0:1788841934.466264:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500686720 00000100:00100000:0.0:1788841934.466330:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788841934.466341:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500686720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788841934.466394:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788841934.466476:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500686720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841934.466485:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1788841934.466514:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788841934.466630:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7c5d3b80 x1875736500686720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841934.466650:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500686720:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788841934.726070:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841934.761802:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841934.761860:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841934.761889:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841934.761931:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489115392 00000100:00100000:0.0:1788841934.761952:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489115392 00000100:00100000:2.0:1788841934.762134:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489115264 00000100:00100000:2.0:1788841934.762138:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489115264 00000100:00100000:2.0:1788841934.762179:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 247 00000100:00100000:2.0:1788841934.762188:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2349:x1875736489115264:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788841934.762254:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2349:x1875736489115264:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 67us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841934.762263:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 247 00000100:00100000:1.0:1788841934.762473:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489115520 00000100:00100000:1.0:1788841934.762477:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489115520 00000100:00100000:0.0:1788841934.762537:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 95 00000100:00100000:0.0:1788841934.762546:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2349:x1875736489115392:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788841934.762586:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2349:x1875736489115392:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 42us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841934.762593:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 95 00000100:00080000:2.0:1788841934.765909:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788841934.769662:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 96 00000100:00100000:1.0:1788841934.769685:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2349:x1875736489115520:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788841934.769776:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2349:x1875736489115520:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 102us (7885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841934.769784:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 96 00010000:00010000:3.0:1788841935.759820:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841936.791494:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841937.026054:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875736500686976:0@lo:400:kworker.0 00000100:00100000:0.0:1788841937.026132:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841937.026201:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7617ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500687488:0@lo:400:kworker.0 00000100:00100000:0.0:1788841937.026230:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841937.026267:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788841937.026273:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500686848:0@lo:400:kworker.0 00000100:00100000:0.0:1788841937.026310:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841937.026332:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76178e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500687360:0@lo:400:kworker.0 00000100:00100000:0.0:1788841937.026353:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841937.026379:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7617aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500687104:0@lo:400:kworker.0 00000100:00100000:0.0:1788841937.026402:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841937.026421:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788841937.026426:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500687232:0@lo:400:kworker.0 00000100:00100000:0.0:1788841937.026448:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841937.026479:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500687488 00000100:00100000:0.0:1788841937.026487:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500687488 00000100:00100000:0.0:1788841937.026539:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500687232 00000100:00100000:0.0:1788841937.026543:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500687232 00000100:00100000:0.0:1788841937.026566:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788841937.027026:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7617bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500687488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841937.027087:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7617bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500687488:12345-0@lo:400:kworker.0 Request processed in 67us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841937.027108:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788841937.027128:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788841937.027134:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76178000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500687232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841937.027169:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76178000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500687232:12345-0@lo:400:kworker.0 Request processed in 35us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841937.027174:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788841937.027209:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500686848 00000100:00100000:0.0:1788841937.027214:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500686848 00000100:00100000:0.0:1788841937.027242:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788841937.027248:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3308:x1875736500686848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841937.027279:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3308:x1875736500686848:12345-0@lo:400:kworker.0 Request processed in 31us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841937.027285:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788841937.027325:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500686976 00000100:00100000:0.0:1788841937.027329:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500686976 00000100:00100000:0.0:1788841937.027356:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500687360 00000100:00100000:0.0:1788841937.027359:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500687360 00000100:00100000:0.0:1788841937.027376:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500687104 00000100:00100000:0.0:1788841937.027379:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500687104 00000100:00100000:0.0:1788841937.027395:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788841937.027400:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76179180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875736500686976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841937.027431:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76179180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875736500686976:12345-0@lo:400:kworker.0 Request processed in 31us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841937.027438:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788841937.027450:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788841937.027456:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7617a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500687360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841937.027495:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7617a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500687360:12345-0@lo:400:kworker.0 Request processed in 39us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841937.027502:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788841937.027513:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788841937.027519:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500687104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841937.027545:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500687104:12345-0@lo:400:kworker.0 Request processed in 27us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841937.027551:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1788841937.027800:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788841937.027806:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788841937.027808:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788841937.027862:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76179880 x1875736500687232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841937.027876:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500687232:0@lo:400:kworker.0 00000100:00100000:0.0:1788841937.027888:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7617aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500687104:0@lo:400:kworker.0 00000100:00100000:0.0:1788841937.027923:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500686848:0@lo:400:kworker.0 00000100:00100000:0.0:1788841937.027934:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76178e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500687360:0@lo:400:kworker.0 00000100:00100000:0.0:1788841937.027952:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875736500686976:0@lo:400:kworker.0 00010000:00080000:0.0:1788841937.027965:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7617ad80 x1875736500687488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841937.027974:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7617ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500687488:0@lo:400:kworker.0 00000100:00100000:3.0:1788841937.538384:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500687616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788841937.538458:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841937.538538:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500687616 00000100:00100000:3.0:1788841937.538547:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500687616 00000100:00100000:3.0:1788841937.538597:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788841937.538606:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500687616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788841937.538642:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788841937.538689:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500687616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841937.538697:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1788841937.538761:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7c5d1f80 x1875736500687616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841937.538779:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500687616:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788841937.795060:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788841937.990434:0:11362:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788841938.818338:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841939.592671:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788841939.592695:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4926fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500687744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788841939.592787:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841939.593777:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500687744 00000100:00100000:3.0:1788841939.593788:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500687744 00000100:00100000:3.0:1788841939.593861:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788841939.593870:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500687744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788841939.593903:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788841939.593965:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500687744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841939.593971:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788841939.594018:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a4926fb80 x1875736500687744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841939.594038:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4926fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500687744:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788841939.595925:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788841939.842468:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841939.889689:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841939.889772:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841939.889806:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841939.889893:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489115648 00000100:00100000:2.0:1788841939.889907:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489115648 00000100:00100000:2.0:1788841939.889970:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 249 00000100:00100000:2.0:1788841939.889980:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2350:x1875736489115648:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788841939.890053:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2350:x1875736489115648:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 74us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841939.890060:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 249 00000100:00100000:0.0:1788841939.890145:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489115776 00000100:00100000:0.0:1788841939.890150:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489115776 00000100:00100000:3.0:1788841939.890169:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489115904 00000100:00100000:3.0:1788841939.890183:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489115904 00000100:00100000:0.0:1788841939.890232:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 100 00000100:00100000:0.0:1788841939.890256:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2350:x1875736489115776:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841939.890272:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 101 00000100:00100000:3.0:1788841939.890289:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489115904:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788841939.890303:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2350:x1875736489115776:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 59us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841939.890313:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 100 00000100:00100000:3.0:1788841939.890492:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489115904:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 207us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841939.890503:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 101 00000100:00080000:2.0:1788841939.890531:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788841940.865935:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841941.907563:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841942.146381:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500688128:0@lo:400:kworker.0 00000100:00100000:2.0:1788841942.146463:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841942.146563:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788841942.146570:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500688256:0@lo:400:kworker.0 00000100:00100000:2.0:1788841942.146601:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841942.146647:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500688128 00000100:00100000:2.0:1788841942.146655:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500688128 00000100:00100000:2.0:1788841942.146733:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788841942.146743:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7681b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500688128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841942.146800:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7681b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500688128:12345-0@lo:400:kworker.0 Request processed in 59us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841942.146809:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788841942.146838:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500688256 00000100:00100000:2.0:1788841942.146842:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500688256 00000100:00100000:3.0:1788841942.147219:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500687872:0@lo:400:kworker.0 00000100:00100000:2.0:1788841942.147231:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788841942.147241:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500688256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841942.147265:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841942.147291:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500688256:12345-0@lo:400:kworker.0 Request processed in 51us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841942.147299:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788841942.147306:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875736500688384:0@lo:400:kworker.0 00000100:00080000:2.0:1788841942.147321:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788841942.147327:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788841942.147336:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788841942.147362:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a761bd500 x1875736500688256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841942.147377:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500688256:0@lo:400:kworker.0 00000100:00100000:2.0:1788841942.147389:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500688128:0@lo:400:kworker.0 00000100:00100000:2.0:1788841942.147429:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500687872 00000100:00100000:2.0:1788841942.147433:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500687872 00000100:00100000:3.0:1788841942.147437:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788841942.147446:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500688000:0@lo:400:kworker.0 00000100:00100000:2.0:1788841942.147478:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788841942.147479:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841942.147489:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3307:x1875736500687872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841942.147515:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7681b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500688512:0@lo:400:kworker.0 00000100:00100000:3.0:1788841942.147545:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841942.147613:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500688512 00000100:00100000:0.0:1788841942.147618:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500688512 00000100:00100000:0.0:1788841942.147738:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788841942.147747:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76867800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500688512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841942.148046:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3307:x1875736500687872:12345-0@lo:400:kworker.0 Request processed in 558us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841942.148054:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788841942.148146:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76867800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500688512:12345-0@lo:400:kworker.0 Request processed in 399us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841942.148153:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1788841942.148175:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788841942.148259:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500687872:0@lo:400:kworker.0 00010000:00080000:3.0:1788841942.148282:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7681b800 x1875736500688512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841942.148293:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7681b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500688512:0@lo:400:kworker.0 00000100:00100000:3.0:1788841942.148318:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500688384 00000100:00100000:3.0:1788841942.148322:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500688384 00000100:00100000:3.0:1788841942.148406:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500688000 00000100:00100000:3.0:1788841942.148410:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500688000 00000100:00100000:3.0:1788841942.148432:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788841942.148441:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875736500688384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841942.148483:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875736500688384:12345-0@lo:400:kworker.0 Request processed in 45us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841942.148489:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788841942.148501:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788841942.148506:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500688000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841942.148529:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500688000:12345-0@lo:400:kworker.0 Request processed in 24us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841942.148535:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788841942.148567:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500688000:0@lo:400:kworker.0 00000100:00100000:3.0:1788841942.148576:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875736500688384:0@lo:400:kworker.0 00000100:00080000:0.0:1788841942.148693:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1788841942.279070:0:11461:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 00:32:19 (1788841939) === 00000100:00100000:1.0:1788841942.507404:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841942.507441:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841942.507522:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489116032 00000100:00100000:2.0:1788841942.507533:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489116032 00000100:00100000:2.0:1788841942.507611:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 14 00000100:00100000:2.0:1788841942.507622:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2351:x1875736489116032:12345-192.168.204.55@tcp:41:mkdir.0 00000004:00000024:2.0:1788841942.507670:0:5851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788841942.507777:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2351:x1875736489116032:12345-192.168.204.55@tcp:41:mkdir.0 Request processed in 157us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841942.507785:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 14 00000100:00080000:3.0:1788841942.507853:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788841942.507888:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489116160 00000100:00100000:0.0:1788841942.507896:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489116160 00000100:00100000:2.0:1788841942.508057:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:2.0:1788841942.508064:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:9697:x1875736489116160:12345-192.168.204.55@tcp:700:mkdir.0 00000100:00100000:2.0:1788841942.508103:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:9697:x1875736489116160:12345-192.168.204.55@tcp:700:mkdir.0 Request processed in 39us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841942.508111:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:0.0:1788841942.520996:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841942.521200:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489116416 00000100:00100000:3.0:1788841942.521210:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489116416 00000100:00100000:3.0:1788841942.521301:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00100000:3.0:1788841942.521312:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7617ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:9697:x1875736489116416:12345-192.168.204.55@tcp:36:mkdir.0 00010000:00010000:3.0:1788841942.521541:0:6963:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841942.521694:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b0c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef204f expref: 6 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.521989:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a428df700) 00010000:00010000:3.0:1788841942.522001:0:6963:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788841942.522903:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b1e4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.522925:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b1e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.522936:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b1e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.522989:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc600/0x3de1064d33a8b1eb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.522998:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc600/0x3de1064d33a8b1eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.523005:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc600/0x3de1064d33a8b1eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841942.524142:0:6963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788841942.524157:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b1e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.524167:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b1e4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.524174:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b1e4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.524180:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cca00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788841942.524184:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b1e4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.524204:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b1e4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.524218:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a61283300) 00010000:00010000:2.0:1788841942.524226:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788841942.524231:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b1e4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.524248:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b1e4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788841942.524267:0:6963:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb432804 reply state 00000000e3bd10da transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc600/0x3de1064d33a8b1eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841942.524277:0:6963:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788841942.524386:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7617ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:9697:x1875736489116416:12345-192.168.204.55@tcp:36:mkdir.0 Request processed in 3072us (3400us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788841942.524395:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00100000:1.0:1788841942.538400:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00010000:00010000:0.0:1788841942.538413:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc600/0x3de1064d33a8b1eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841942.538442:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc600/0x3de1064d33a8b1eb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841942.538451:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc600/0x3de1064d33a8b1eb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841942.538460:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cc600 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841942.538465:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc600/0x3de1064d33a8b1eb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841942.538490:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc600/0x3de1064d33a8b1eb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841942.538510:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d3a61283a00) 00010000:00010000:0.0:1788841942.538513:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841942.538518:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc600/0x3de1064d33a8b1eb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841942.538524:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc600/0x3de1064d33a8b1eb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841942.538685:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489116544 00000100:00100000:2.0:1788841942.538695:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489116544 00000100:00100000:2.0:1788841942.538785:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:2.0:1788841942.538795:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:9698:x1875736489116544:12345-192.168.204.55@tcp:101:chmod.0 00010000:00010000:2.0:1788841942.538814:0:8623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841942.538833:0:8623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b1f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef20d4 expref: -99 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.538901:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b1f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.538912:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b1f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.538923:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b1f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841942.538955:0:8623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788841942.538959:0:8623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788841942.539002:0:8623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b1f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.539027:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b1f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20d4 expref: 8 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.539041:0:8623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b1f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20d4 expref: 7 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.539049:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a61283300) 00010000:00010000:2.0:1788841942.539051:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788841942.539054:0:8623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cd200, rc 0) 00000100:00100000:2.0:1788841942.539142:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:9698:x1875736489116544:12345-192.168.204.55@tcp:101:chmod.0 Request processed in 348us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841942.539148:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:1.0:1788841942.546967:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841942.547034:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489116800 00000100:00100000:2.0:1788841942.547051:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489116800 00000100:00100000:2.0:1788841942.547132:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:2.0:1788841942.547143:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:9698:x1875736489116800:12345-192.168.204.55@tcp:36:chmod.0 00010000:00010000:2.0:1788841942.547217:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788841942.547245:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b1f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20d4 expref: 7 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.547265:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a61283300) 00010000:00010000:2.0:1788841942.547276:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788841942.547305:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8b200 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.547318:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8b200 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.547342:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8b200 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788841942.547686:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a02ec220 reply state 00000000eda42fff transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8b200 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841942.547696:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788841942.547705:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788841942.548038:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:9698:x1875736489116800:12345-192.168.204.55@tcp:36:chmod.0 Request processed in 894us (1085us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788841942.548046:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 17 00010000:00010000:3.0:1788841942.551260:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8b200 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.551278:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8b200 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.551286:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8b200 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.551292:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cdc00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841942.551297:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8b200 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.551305:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8b200 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.551320:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a61283200) 00010000:00010000:3.0:1788841942.551323:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788841942.551328:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8b200 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.551335:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8b200 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841942.581497:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841942.581626:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489116928 00000100:00100000:2.0:1788841942.581642:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489116928 00000100:00100000:2.0:1788841942.581767:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 18 00000100:00100000:2.0:1788841942.581778:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:9699:x1875736489116928:12345-192.168.204.55@tcp:101:chown.0 00010000:00010000:2.0:1788841942.581806:0:6963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841942.581829:0:6963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b207 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef20db expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.581894:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b20e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.581907:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b20e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.581918:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b20e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841942.581963:0:6963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788841942.581979:0:6963:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788841942.582015:0:6963:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b20e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.582037:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b207 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20db expref: 9 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.582053:0:6963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b20e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20db expref: 8 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.582061:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a61283300) 00010000:00010000:2.0:1788841942.582063:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788841942.582066:0:6963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cca00, rc 0) 00000100:00100000:2.0:1788841942.582126:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:9699:x1875736489116928:12345-192.168.204.55@tcp:101:chown.0 Request processed in 351us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841942.582133:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 18 00000100:00100000:0.0:1788841942.586151:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841942.587853:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489117056 00000100:00100000:2.0:1788841942.587874:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489117056 00000100:00100000:2.0:1788841942.587965:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 19 00000100:00100000:2.0:1788841942.587982:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:9699:x1875736489117056:12345-192.168.204.55@tcp:101:chown.0 00010000:00010000:2.0:1788841942.588007:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841942.588031:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b215 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef20e2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.588104:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b21c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.588121:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b21c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.588156:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b21c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.588171:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b223 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.588179:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b223 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.588206:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b223 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.588295:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b22a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.588304:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b22a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.588311:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b22a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841942.588344:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788841942.588349:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788841942.588368:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b22a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.588380:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b21c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.588386:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b21c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.588402:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b21c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.588409:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cce00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788841942.588413:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b21c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.588421:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b21c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.588433:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a61283300) 00010000:00010000:2.0:1788841942.588436:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788841942.588441:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b21c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.588447:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b21c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.588460:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b223 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.588467:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b223 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.588473:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b223 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.588478:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788841942.588481:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b223 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.588495:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b223 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.588503:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d3a61283900) 00010000:00010000:2.0:1788841942.588505:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788841942.588508:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b223 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.588514:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b223 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.588545:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b215 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20e2 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.588559:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b22a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20e2 expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.588567:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d3a61283400) 00010000:00010000:2.0:1788841942.588569:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788841942.588572:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cc000, rc 0) 00000100:00100000:2.0:1788841942.588649:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:9699:x1875736489117056:12345-192.168.204.55@tcp:101:chown.0 Request processed in 672us (2513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841942.588657:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 19 00000100:00100000:0.0:1788841942.591332:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841942.594515:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489117312 00000100:00100000:2.0:1788841942.594532:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489117312 00000100:00100000:2.0:1788841942.594617:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 20 00000100:00100000:2.0:1788841942.594630:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7617aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:9699:x1875736489117312:12345-192.168.204.55@tcp:36:chown.0 00010000:00010000:2.0:1788841942.594699:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788841942.594763:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b22a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20e2 expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.594782:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d3a61283400) 00010000:00010000:2.0:1788841942.594791:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788841942.594820:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b231 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.594835:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b231 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.594844:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b231 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841942.658793:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788841942.658822:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500688640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788841942.658914:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841942.659005:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500688640 00000100:00100000:0.0:1788841942.659013:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500688640 00000100:00100000:0.0:1788841942.659072:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788841942.659081:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500688640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788841942.659129:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788841942.659181:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500688640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841942.659199:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1788841942.659841:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76179880 x1875736500688640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841942.659867:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500688640:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788841942.664151:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1788841942.664165:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d19885ad reply state 00000000b46c1600 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b231 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841942.664182:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788841942.664217:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:2.0:1788841942.664399:0:5850:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788841942.664425:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7617aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:9699:x1875736489117312:12345-192.168.204.55@tcp:36:chown.0 Request processed in 69790us (73101us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788841942.664435:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 20 00010000:00010000:1.0:1788841942.664445:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b231 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.664462:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b231 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.664471:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b231 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.664479:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cc200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788841942.664484:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b231 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.664493:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b231 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.664513:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d3a61283900) 00010000:00010000:1.0:1788841942.664516:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788841942.664522:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b231 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.664527:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b231 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841942.684688:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841942.684987:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489117440 00000100:00100000:2.0:1788841942.685002:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489117440 00000100:00100000:2.0:1788841942.685136:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00100000:2.0:1788841942.685147:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:9700:x1875736489117440:12345-192.168.204.55@tcp:101:touch.500 00010000:00010000:2.0:1788841942.685179:0:6963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841942.685219:0:6963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b238 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef20e9 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788841942.686994:0:6963:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1611us 00010000:00010000:1.0:1788841942.737915:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b23f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.738091:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b23f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.738104:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b23f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.738121:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531000/0x3de1064d33a8b246 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.738135:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531000/0x3de1064d33a8b246 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.738143:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531000/0x3de1064d33a8b246 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.742860:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b24d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.742884:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b24d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.742895:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b24d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788841942.742932:0:6963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788841942.742935:0:6963:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788841942.742972:0:6963:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b24d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.742986:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b23f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.742994:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b23f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.743001:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b23f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.743008:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43531800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788841942.743012:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b23f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.743027:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b23f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.743041:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a61283300) 00010000:00010000:1.0:1788841942.743044:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841942.743048:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b23f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.743055:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b23f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.743066:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531000/0x3de1064d33a8b246 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.743073:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531000/0x3de1064d33a8b246 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.743079:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531000/0x3de1064d33a8b246 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.743084:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43531000 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788841942.743087:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531000/0x3de1064d33a8b246 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.743093:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531000/0x3de1064d33a8b246 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.743100:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d3a428dfb00) 00010000:00010000:1.0:1788841942.743103:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841942.743106:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531000/0x3de1064d33a8b246 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.743122:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531000/0x3de1064d33a8b246 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.743164:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b238 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20e9 expref: 8 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.743179:0:6963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b24d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20e9 expref: 7 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.743200:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d3a428df000) 00010000:00010000:1.0:1788841942.743203:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788841942.743205:0:6963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43530800, rc 0) 00000100:00100000:1.0:1788841942.743291:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:9700:x1875736489117440:12345-192.168.204.55@tcp:101:touch.500 Request processed in 58144us (58618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841942.743300:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00100000:1.0:1788841942.750141:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841942.751369:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489117696 00000100:00100000:2.0:1788841942.751383:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489117696 00000100:00100000:2.0:1788841942.751455:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 22 00000100:00100000:2.0:1788841942.751468:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:9700:x1875736489117696:12345-192.168.204.55@tcp:101:touch.500 00010000:00010000:2.0:1788841942.751489:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841942.751511:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b254 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef20f0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.753105:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b25b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.753127:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b25b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.753139:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b25b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.753201:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b262 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.753210:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b262 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.753216:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b262 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788841942.755634:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788841942.756137:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b269 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.756160:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.756176:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.756239:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b25b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.756247:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b25b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.756255:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b25b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.756262:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841942.756267:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b25b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.756276:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b25b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.756292:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d3a428df000) 00010000:00010000:3.0:1788841942.756295:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841942.756301:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b25b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.756365:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b25b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788841942.756383:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bdf4aa88 reply state 00000000e4488176 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b262 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841942.756394:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788841942.756442:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b254 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20f0 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.756460:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b269 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20f0 expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.756469:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d3a821d0300) 00010000:00010000:3.0:1788841942.756471:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788841942.756474:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60052800, rc 0) 00000100:00100000:3.0:1788841942.756576:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+10:9700:x1875736489117696:12345-192.168.204.55@tcp:101:touch.500 Request processed in 5110us (6453us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788841942.756586:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 22 00010000:00010000:1.0:1788841942.763046:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b262 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.763066:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b262 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.763075:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b262 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.763081:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788841942.763087:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b262 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.763121:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b262 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.763138:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x83a5f26b (ffff8d3a61283400) 00010000:00010000:1.0:1788841942.763142:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841942.763147:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b262 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.763154:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b262 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841942.765853:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841942.766343:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489117952 00000100:00100000:2.0:1788841942.766355:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489117952 00000100:00100000:2.0:1788841942.766416:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 23 00000100:00100000:2.0:1788841942.766440:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:9700:x1875736489117952:12345-192.168.204.55@tcp:36:touch.500 00010000:00010000:2.0:1788841942.766513:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788841942.766541:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b269 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20f0 expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.766562:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d3a821d0300) 00010000:00010000:2.0:1788841942.766573:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788841942.766619:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b277 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.766632:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b277 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.766642:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b277 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788841942.766830:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004daa97fd reply state 00000000c054c632 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b277 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841942.766841:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788841942.767351:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+10:9700:x1875736489117952:12345-192.168.204.55@tcp:36:touch.500 Request processed in 910us (1505us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788841942.767359:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 23 00010000:00010000:3.0:1788841942.776232:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b277 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.776252:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b277 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.776261:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b277 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.776267:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cda00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841942.776289:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b277 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.776298:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b277 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.776315:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d3a61283200) 00010000:00010000:3.0:1788841942.776318:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841942.776324:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b277 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.776331:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b277 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841942.776659:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841942.777555:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489118080 00000100:00100000:3.0:1788841942.777569:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489118080 00000100:00100000:3.0:1788841942.777637:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 24 00000100:00100000:3.0:1788841942.777648:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:9700:x1875736489118080:12345-192.168.204.55@tcp:101:touch.500 00010000:00010000:3.0:1788841942.777675:0:6963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841942.777696:0:6963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b27e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef20f7 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.777795:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b27e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20f7 expref: 10 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.777808:0:6963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b27e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20f7 expref: 10 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.777827:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d3a821d0100) 00010000:00010000:3.0:1788841942.777831:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788841942.777857:0:6963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60052400, rc 0) 00000100:00100000:3.0:1788841942.778430:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+10:9700:x1875736489118080:12345-192.168.204.55@tcp:101:touch.500 Request processed in 782us (1775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841942.778439:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 24 00000100:00100000:2.0:1788841942.804080:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841942.804425:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489118208 00000100:00100000:0.0:1788841942.804434:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489118208 00000100:00100000:0.0:1788841942.804498:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:0.0:1788841942.804507:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1875736489118208:12345-192.168.204.55@tcp:8:touch.500 00010000:00080000:0.0:1788841942.804539:0:8622:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 090c7b3c-cdb1-4c0e-9553-671552ee3fa2@192.168.204.55@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:0.0:1788841942.804571:0:8622:0:(genops.c:1385:class_connect()) connect: client 090c7b3c-cdb1-4c0e-9553-671552ee3fa2, cookie 0x3de1064d33a8b285 00002000:00100000:0.0:1788841942.804583:0:8622:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 090c7b3c-cdb1-4c0e-9553-671552ee3fa2/ffff8d3a75de4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113972 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788841942.804606:0:8622:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:0.0:1788841942.804908:0:8622:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788841942.804940:0:8622:0:(import.c:65:import_set_state_nolock()) ffff8d3a75de2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788841942.804999:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2348:x1875736489118208:12345-192.168.204.55@tcp:8:touch.500 Request processed in 491us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841942.805008:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:0.0:1788841942.808561:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841942.808674:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489118336 00000100:00100000:2.0:1788841942.808686:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489118336 00000100:00100000:2.0:1788841942.808815:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:2.0:1788841942.808827:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7617b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:0:x1875736489118336:12345-192.168.204.55@tcp:2:touch.500 00000100:00080000:3.0:1788841942.809407:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1788841942.882348:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 090c7b3c-cdb1-4c0e-9553-671552ee3fa2 00000001:00080000:3.0:1788841942.882368:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1788841942.882809:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7617b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:0:x1875736489118336:12345-192.168.204.55@tcp:2:touch.500 Request processed in 73977us (74254us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788841942.882821:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:1.0:1788841942.887030:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841942.887462:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489118592 00000100:00100000:3.0:1788841942.887473:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489118592 00000100:00100000:3.0:1788841942.887529:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 2 00000100:00100000:3.0:1788841942.887539:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+10:9700:x1875736489118592:12345-192.168.204.55@tcp:35:touch.500 00000100:00100000:3.0:1788841942.889370:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+11:9700:x1875736489118592:12345-192.168.204.55@tcp:35:touch.500 Request processed in 1822us (2340us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788841942.889383:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 2 00010000:00010000:2.0:1788841942.917743:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841942.929783:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841942.929983:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489118720 00000100:00100000:0.0:1788841942.929994:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489118720 00000100:00100000:0.0:1788841942.930059:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 25 00000100:00100000:0.0:1788841942.930069:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+11:9701:x1875736489118720:12345-192.168.204.55@tcp:101:rm.0 00010000:00010000:0.0:1788841942.930094:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841942.930115:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b28c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef20fe expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841942.930233:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b293 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841942.930249:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841942.930260:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788841942.930296:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788841942.930300:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788841942.930338:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841942.930363:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b28c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20fe expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841942.930384:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b293 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20fe expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841942.930394:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d3a428df000) 00010000:00010000:0.0:1788841942.930397:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788841942.930401:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78e800, rc 0) 00000100:00100000:0.0:1788841942.930458:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+12:9701:x1875736489118720:12345-192.168.204.55@tcp:101:rm.0 Request processed in 391us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841942.930467:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 25 00000100:00100000:0.0:1788841942.946802:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841942.947035:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489118976 00000100:00100000:2.0:1788841942.947046:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489118976 00000100:00100000:2.0:1788841942.947107:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 26 00000100:00100000:2.0:1788841942.947118:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+12:9701:x1875736489118976:12345-192.168.204.55@tcp:101:rm.0 00010000:00010000:2.0:1788841942.947138:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841942.947159:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b29a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2105 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841942.947271:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788841942.947399:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b29a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2105 expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.947418:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a61283300) 00010000:00010000:2.0:1788841942.947421:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788841942.947427:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b29a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2105 expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841942.947440:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cda00, rc 0) 00000100:00100000:2.0:1788841942.947514:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+13:9701:x1875736489118976:12345-192.168.204.55@tcp:101:rm.0 Request processed in 398us (723us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1788841942.947522:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 26 00000100:00100000:1.0:1788841942.955781:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841942.955922:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489119104 00000100:00100000:0.0:1788841942.955948:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489119104 00000100:00100000:0.0:1788841942.956011:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 3 00000100:00100000:0.0:1788841942.956022:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+13:9701:x1875736489119104:12345-192.168.204.55@tcp:37:rm.0 00000100:00100000:0.0:1788841942.962428:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+13:9701:x1875736489119104:12345-192.168.204.55@tcp:37:rm.0 Request processed in 6394us (6643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841942.962443:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 3 00000100:00100000:1.0:1788841942.970459:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841942.970695:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489119360 00000100:00100000:2.0:1788841942.970748:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489119360 00000100:00100000:2.0:1788841942.970807:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 4 00000100:00100000:2.0:1788841942.970818:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a658de050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+13:9701:x1875736489119360:12345-192.168.204.55@tcp:35:rm.0 00000100:00100000:2.0:1788841942.971122:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a658de050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+14:9701:x1875736489119360:12345-192.168.204.55@tcp:35:rm.0 Request processed in 303us (674us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788841942.971149:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 4 00000100:00100000:1.0:1788841942.976791:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841942.976936:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489119616 00000100:00100000:3.0:1788841942.976947:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489119616 00000100:00100000:3.0:1788841942.977008:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 27 00000100:00100000:3.0:1788841942.977019:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+14:9701:x1875736489119616:12345-192.168.204.55@tcp:101:rm.0 00010000:00010000:3.0:1788841942.977042:0:6963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841942.977061:0:6963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b2a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef210c expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.977150:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b2af lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.977163:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b2af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.977203:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b2af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788841942.977214:0:6963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788841942.977469:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b2a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef210c expref: 17 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.977489:0:6963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b2af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef210c expref: 16 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841942.977498:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d3a428df000) 00010000:00010000:3.0:1788841942.977501:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788841942.977504:0:6963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60053800, rc 0) 00000100:00100000:3.0:1788841942.977805:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+16:9701:x1875736489119616:12345-192.168.204.55@tcp:101:rm.0 Request processed in 559us (797us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788841942.977815:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 27 00000100:00100000:0.0:1788841942.982562:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841942.982742:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489119744 00000100:00100000:3.0:1788841942.982754:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489119744 00000100:00100000:3.0:1788841942.982813:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 28 00000100:00100000:3.0:1788841942.982823:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+16:9701:x1875736489119744:12345-192.168.204.55@tcp:41:rm.0 00000004:00000024:3.0:1788841942.982898:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1788841942.982993:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+16:9701:x1875736489119744:12345-192.168.204.55@tcp:41:rm.0 Request processed in 169us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841942.983000:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 28 00000100:00100000:0.0:1788841942.996888:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841942.997325:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489119872 00000100:00100000:1.0:1788841942.997336:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489119872 00000100:00100000:1.0:1788841942.997403:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 29 00000100:00100000:1.0:1788841942.997415:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+16:9701:x1875736489119872:12345-192.168.204.55@tcp:101:rm.0 00010000:00010000:1.0:1788841942.997437:0:8623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841942.997473:0:8623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530a00/0x3de1064d33a8b2bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2113 expref: -99 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.997541:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b2c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.997556:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b2c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.997736:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b2c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.997756:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531400/0x3de1064d33a8b2cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.997764:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531400/0x3de1064d33a8b2cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841942.997770:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531400/0x3de1064d33a8b2cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.001866:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8b2d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.001889:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8b2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.001901:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8b2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788841943.001954:0:8623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788841943.001959:0:8623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788841943.001977:0:8623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8b2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.001990:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8b2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.002000:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b2c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.002007:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b2c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.002014:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b2c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.002032:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43530400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841943.002036:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b2c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.002043:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b2c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.002056:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d3a428df000) 00010000:00010000:0.0:1788841943.002058:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841943.002062:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b2c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.002069:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b2c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.002081:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531400/0x3de1064d33a8b2cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.002087:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531400/0x3de1064d33a8b2cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.002093:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531400/0x3de1064d33a8b2cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.002099:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43531400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841943.002101:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531400/0x3de1064d33a8b2cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.002107:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531400/0x3de1064d33a8b2cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.002121:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x83a5f26b (ffff8d3a428dfe00) 00010000:00010000:0.0:1788841943.002124:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841943.002127:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531400/0x3de1064d33a8b2cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.002132:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531400/0x3de1064d33a8b2cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.002168:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530a00/0x3de1064d33a8b2bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2113 expref: 18 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.002191:0:8623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8b2d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2113 expref: 17 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.002198:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d3a821d0100) 00010000:00010000:0.0:1788841943.002201:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788841943.002203:0:8623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78fa00, rc 0) 00000100:00100000:0.0:1788841943.002282:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+17:9701:x1875736489119872:12345-192.168.204.55@tcp:101:rm.0 Request processed in 4868us (5403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841943.002291:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 29 00000100:00100000:1.0:1788841943.011978:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841943.012036:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489120128 00000100:00100000:3.0:1788841943.012047:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489120128 00000100:00100000:3.0:1788841943.012136:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 30 00000100:00100000:3.0:1788841943.012147:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+17:9701:x1875736489120128:12345-192.168.204.55@tcp:36:rm.0 00010000:00010000:3.0:1788841943.012212:0:6963:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788841943.012240:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8b2d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2113 expref: 17 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.012263:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b27e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20f7 expref: 16 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.012275:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d3a821d0100) 00010000:00010000:3.0:1788841943.012291:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b293 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20fe expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.012300:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d3a428df000) 00010000:00010000:3.0:1788841943.012304:0:6963:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788841943.012326:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b2d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.012338:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b2d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.012348:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b2d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.012362:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b2e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.012369:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b2e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.012387:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b2e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.012512:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b2e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.012520:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b2e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.012527:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b2e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788841943.013371:0:6963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788841943.013383:0:6963:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 271170672878ns, next at 272170670418ns, rc = 0 00010000:00010000:3.0:1788841943.013450:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030800/0x3de1064d33a8b2ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.013461:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030800/0x3de1064d33a8b2ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.013470:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030800/0x3de1064d33a8b2ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.013479:0:6963:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030800/0x3de1064d33a8b2ee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.013484:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030800/0x3de1064d33a8b2ee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.013491:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030800/0x3de1064d33a8b2ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.013526:0:6963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788841943.013547:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b2e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.013554:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b2e7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.013559:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b2e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.013566:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052a00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841943.013569:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b2e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.013577:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b2e7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.013587:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:3.0:1788841943.013590:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788841943.013594:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b2e7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.013600:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b2e7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.013611:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788841943.013615:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b2d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.013618:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030800/0x3de1064d33a8b2ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.013621:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b2d9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.013624:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40030800 already unused, calling callback (ffffffffc1813420) 00010000:00010000:3.0:1788841943.013627:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b2d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.013628:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030800/0x3de1064d33a8b2ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.013637:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841943.013640:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b2d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.013646:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b2d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.013651:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030800/0x3de1064d33a8b2ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.013654:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d3a428df000) 00010000:00010000:3.0:1788841943.013657:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841943.013660:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b2d9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.013660:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:0.0:1788841943.013662:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788841943.013665:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030800/0x3de1064d33a8b2ee lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.013666:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b2d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.013671:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030800/0x3de1064d33a8b2ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788841943.013676:0:6963:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007fad16d1 reply state 00000000c8b978b9 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b2e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841943.013684:0:6963:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788841943.013684:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841943.013686:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841943.013688:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841943.013798:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+16:9701:x1875736489120128:12345-192.168.204.55@tcp:36:rm.0 Request processed in 1650us (1831us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788841943.013807:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 30 00000100:00100000:2.0:1788841943.023908:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841943.024158:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489120384 00000100:00100000:3.0:1788841943.024168:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489120384 00000100:00100000:3.0:1788841943.024238:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 5 00000100:00100000:3.0:1788841943.024250:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7681b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+16:9701:x1875736489120384:12345-192.168.204.55@tcp:35:rm.0 00000100:00100000:3.0:1788841943.024490:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7681b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+17:9701:x1875736489120384:12345-192.168.204.55@tcp:35:rm.0 Request processed in 242us (593us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788841943.024516:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 5 00000100:00100000:3.0:1788841943.029016:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841943.029073:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489120640 00000100:00100000:0.0:1788841943.029084:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489120640 00000100:00100000:0.0:1788841943.029149:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 31 00000100:00100000:0.0:1788841943.029161:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+17:9701:x1875736489120640:12345-192.168.204.55@tcp:36:rm.0 00010000:00010000:0.0:1788841943.029236:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788841943.029264:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b2af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef210c expref: 17 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.029450:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b24d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20e9 expref: 16 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.029476:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d3a428df000) 00010000:00010000:0.0:1788841943.029495:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b20e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20db expref: 15 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.029537:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a61283300) 00010000:00010000:0.0:1788841943.029544:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788841943.029573:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8b2f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.030152:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8b2f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.030162:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8b2f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.030188:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e000/0x3de1064d33a8b2fc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.030196:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e000/0x3de1064d33a8b2fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.030204:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e000/0x3de1064d33a8b2fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.030474:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b303 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.030483:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b303 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.030490:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b303 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841943.030732:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b2e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841943.030742:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b2e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841943.030758:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b2e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841943.030764:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053e00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788841943.030769:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b2e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841943.030777:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b2e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841943.030789:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x83a5f26b (ffff8d3a821d0000) 00010000:00010000:1.0:1788841943.030793:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841943.030806:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b2e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841943.030813:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b2e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x83a5f26b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788841943.031529:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788841943.031547:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b303 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.031559:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b303 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.031566:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b303 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.031571:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78e800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841943.031574:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b303 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.031593:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b303 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.031604:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d3a4e719b00) 00010000:00010000:0.0:1788841943.031606:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788841943.031609:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b303 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.031615:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b303 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.031635:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8b2f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.031641:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8b2f5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.031646:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8b2f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.031650:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78fe00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841943.031660:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8b2f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.031665:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8b2f5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.031672:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a4e719800) 00010000:00010000:0.0:1788841943.031675:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841943.031678:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8b2f5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841943.031683:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8b2f5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788841943.031694:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b7cbb1c0 reply state 00000000a426e7af transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e000/0x3de1064d33a8b2fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841943.031703:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788841943.031836:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+15:9701:x1875736489120640:12345-192.168.204.55@tcp:36:rm.0 Request processed in 2674us (2828us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788841943.031846:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 31 00010000:00010000:3.0:1788841943.036302:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e000/0x3de1064d33a8b2fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.036320:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e000/0x3de1064d33a8b2fc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.036327:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e000/0x3de1064d33a8b2fc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.036334:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78e000 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841943.036338:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e000/0x3de1064d33a8b2fc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.036346:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e000/0x3de1064d33a8b2fc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.036363:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d3a4e719300) 00010000:00010000:3.0:1788841943.036366:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841943.036371:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e000/0x3de1064d33a8b2fc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841943.036377:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e000/0x3de1064d33a8b2fc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841943.938972:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841944.705915:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:3.0:1788841944.706159:0:7081:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 272863449004ns, next at 273863446524ns, rc = 0 00000100:00100000:2.0:1788841944.708961:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500688768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788841944.709047:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841944.719171:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500688768 00000100:00100000:3.0:1788841944.719194:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500688768 00000100:00100000:2.0:1788841944.735634:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788841944.735649:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500688768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788841944.735695:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788841944.735826:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500688768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 180us (26779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841944.735834:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788841944.736558:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7c783b80 x1875736500688768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841944.736582:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500688768:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788841944.739070:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788841944.971771:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841945.017193:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841945.017249:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841945.017279:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841945.017311:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841945.017340:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489121024 00000100:00100000:2.0:1788841945.017351:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489121024 00000100:00100000:2.0:1788841945.017417:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 58 00000100:00100000:2.0:1788841945.017428:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2349:x1875736489121024:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788841945.017504:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2349:x1875736489121024:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 78us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841945.017514:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 58 00000100:00100000:2.0:1788841945.017558:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489120896 00000100:00100000:2.0:1788841945.017563:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489120896 00000100:00100000:3.0:1788841945.017596:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489120768 00000100:00100000:2.0:1788841945.017608:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489121152 00000100:00100000:3.0:1788841945.017611:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489120768 00000100:00100000:2.0:1788841945.017616:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489121152 00000100:00100000:2.0:1788841945.017658:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 105 00000100:00100000:2.0:1788841945.017665:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+14:2350:x1875736489120896:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788841945.017745:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+14:2350:x1875736489120896:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 80us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841945.017753:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 105 00000100:00100000:2.0:1788841945.017766:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 106 00000100:00100000:2.0:1788841945.017773:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489121152:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788841945.017813:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489121152:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 40us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841945.017819:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 106 00000100:00080000:2.0:1788841945.017848:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788841945.017853:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788841945.018378:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 251 00000100:00100000:3.0:1788841945.018393:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2349:x1875736489120768:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841945.018486:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2349:x1875736489120768:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 98us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841945.018494:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 251 00010000:00010000:2.0:1788841945.985911:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841947.032165:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841947.266129:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500689152:0@lo:400:kworker.0 00000100:00100000:0.0:1788841947.266211:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841947.266287:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788841947.266294:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500689280:0@lo:400:kworker.0 00000100:00100000:0.0:1788841947.266320:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841947.266360:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500689280 00000100:00100000:0.0:1788841947.266367:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500689280 00000100:00100000:0.0:1788841947.266431:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788841947.266439:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500689280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841947.266525:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500689280:12345-0@lo:400:kworker.0 Request processed in 86us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841947.266533:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1788841947.266554:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788841947.266582:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a767cce00 x1875736500689280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841947.266608:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500689280:0@lo:400:kworker.0 00000100:00100000:1.0:1788841947.267257:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875736500689024:0@lo:400:kworker.0 00000100:00100000:1.0:1788841947.267295:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841947.267328:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500689536:0@lo:400:kworker.0 00000100:00100000:1.0:1788841947.267350:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841947.267380:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788841947.267387:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500688896:0@lo:400:kworker.0 00000100:00100000:1.0:1788841947.267412:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841947.267433:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500689408:0@lo:400:kworker.0 00000100:00100000:1.0:1788841947.267452:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841947.267833:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500689152 00000100:00100000:2.0:1788841947.267840:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500689152 00000100:00100000:2.0:1788841947.267891:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500689024 00000100:00100000:2.0:1788841947.267895:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500689024 00000100:00100000:2.0:1788841947.267910:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500689408 00000100:00100000:2.0:1788841947.267913:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500689408 00000100:00100000:2.0:1788841947.267927:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788841947.267934:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500689152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841947.267984:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500689152:12345-0@lo:400:kworker.0 Request processed in 51us (1784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841947.267991:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788841947.268006:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788841947.268011:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875736500689024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841947.268040:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875736500689024:12345-0@lo:400:kworker.0 Request processed in 29us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841947.268057:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788841947.268070:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788841947.268076:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500689408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841947.268117:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500689408:12345-0@lo:400:kworker.0 Request processed in 41us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841947.268122:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788841947.268139:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500689536 00000100:00100000:2.0:1788841947.268143:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500689536 00000100:00100000:2.0:1788841947.268169:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788841947.268174:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500689536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841947.268217:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500689536:12345-0@lo:400:kworker.0 Request processed in 42us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841947.268759:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788841947.268784:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500688896 00000100:00100000:2.0:1788841947.268789:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500688896 00000100:00100000:2.0:1788841947.268813:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788841947.268818:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3308:x1875736500688896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841947.268855:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3308:x1875736500688896:12345-0@lo:400:kworker.0 Request processed in 36us (1442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841947.268861:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00080000:1.0:1788841947.269034:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788841947.269039:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788841947.269067:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500688896:0@lo:400:kworker.0 00000100:00100000:1.0:1788841947.269105:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500689408:0@lo:400:kworker.0 00000100:00100000:1.0:1788841947.269117:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875736500689024:0@lo:400:kworker.0 00010000:00080000:1.0:1788841947.269128:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a767cdf80 x1875736500689536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841947.269152:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500689536:0@lo:400:kworker.0 00000100:00100000:0.0:1788841947.269790:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500689152:0@lo:400:kworker.0 00000100:00100000:1.0:1788841947.792965:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500689664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788841947.793041:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841947.793128:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500689664 00000100:00100000:1.0:1788841947.793136:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500689664 00000100:00100000:1.0:1788841947.793187:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788841947.793196:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500689664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788841947.793231:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788841947.793280:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500689664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841947.793288:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1788841947.793341:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76213100 x1875736500689664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841947.793361:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500689664:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788841947.861625:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1788841947.861650:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:0.0:1788841947.861665:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788841947.861826:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500689792:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788841947.861892:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841947.865542:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500689792 00000100:00100000:0.0:1788841947.865556:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500689792 00000100:00100000:0.0:1788841947.865618:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788841947.865628:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500689792:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788841947.865665:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1788841947.865726:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9f8fd5, atime: 0x6a9f8fd5, ctime: 0x6a9f8fd5, blocks: 0x1 00010000:00010000:0.0:1788841947.865735:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f3b211d/0x3de1064d33a8b30a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841947.865753:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=276s v=(0 0) 00010000:00010000:0.0:1788841947.865758:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841947.865765:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f3b211d/0x3de1064d33a8b30a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841947.865800:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f3b211d/0x3de1064d33a8b30a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841947.865811:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f3b211d/0x3de1064d33a8b30a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841947.865819:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f3b211d/0x3de1064d33a8b30a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841947.865841:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788841947.866487:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875736500689792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 858us (4591us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788841947.866496:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788841947.866526:0:8448:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788841947.866533:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f3b211d/0x3de1064d33a8b30a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841947.866543:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f600 already unused, calling callback (ffffffffc1813420) 00010000:00010000:0.0:1788841947.866548:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f3b211d/0x3de1064d33a8b30a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841947.866557:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f3b211d/0x3de1064d33a8b30a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841947.866578:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f3b211d/0x3de1064d33a8b30a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841947.866594:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f3b211d/0x3de1064d33a8b30a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841947.866615:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841947.866616:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841947.866618:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788841947.866662:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d3a75ed2d80/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788841947.866670:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500689792:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788841948.035812:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788841948.358116:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:02000400:3.0:1788841948.609137:0:11615:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1788841949.058429:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841949.831886:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788841949.831912:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500689920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788841949.831986:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841949.832181:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500689920 00000100:00100000:3.0:1788841949.832189:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500689920 00000100:00100000:3.0:1788841949.832255:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788841949.832267:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500689920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788841949.832302:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788841949.832349:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500689920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841949.832355:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1788841949.835537:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788841949.835599:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1788841949.835607:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d3a75ed2d80, transno 4294967300 00000100:00100000:1.0:1788841949.835630:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500689920:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788841950.091236:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841950.119762:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841950.119811:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841950.119851:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841950.119878:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841950.119908:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489121408 00000100:00100000:3.0:1788841950.119919:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489121408 00000100:00100000:3.0:1788841950.119974:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489121664 00000100:00100000:3.0:1788841950.119977:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489121664 00000100:00100000:3.0:1788841950.120000:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 110 00000100:00100000:3.0:1788841950.120009:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2352:x1875736489121408:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841950.120103:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2352:x1875736489121408:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 95us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841950.120112:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 110 00000100:00100000:3.0:1788841950.120129:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 111 00000100:00100000:3.0:1788841950.120136:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2352:x1875736489121664:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841950.120161:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2352:x1875736489121664:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 26us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841950.120167:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 111 00000100:00080000:3.0:1788841950.120187:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788841950.120382:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489121536 00000100:00100000:0.0:1788841950.120387:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489121536 00000100:00100000:0.0:1788841950.120432:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 61 00000100:00100000:0.0:1788841950.120439:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2352:x1875736489121536:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788841950.120474:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2352:x1875736489121536:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 36us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841950.120480:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 61 00000100:00100000:1.0:1788841950.121141:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489121280 00000100:00100000:1.0:1788841950.121146:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489121280 00000100:00100000:1.0:1788841950.121196:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 253 00000100:00100000:1.0:1788841950.121215:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2352:x1875736489121280:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788841950.121255:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2352:x1875736489121280:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 43us (1505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841950.121262:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 253 00000100:00080000:3.0:1788841950.121469:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1788841950.136894:0:11664:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc73df5aa0 20000000:00000080:2.0:1788841950.136913:0:11664:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d3a7c43a000 uarg=0000000000000000 20000000:01000000:2.0:1788841950.136948:0:11664:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788841950.136960:0:11664:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788841950.136964:0:11664:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788841950.138770:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788841950.138949:0:11664:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788841950.144097:0:11664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788841950.144542:0:11664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788841950.144629:0:11664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788841950.144657:0:11664:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788841950.144680:0:11664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d3a40031e00/0x3de1064d33a8b311 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.144701:0:11664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a7c6cde00/0x3de1064d33a8b1ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20c6 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.144874:0:11664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a7c78fc00/0x3de1064d33a8b1b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20cd expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.144884:0:11664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8b1c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b1ba expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.144891:0:11664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a7c78e600/0x3de1064d33a8b1cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b1c8 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.144913:0:11664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a7c78ea00/0x3de1064d33a8b1dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b1d6 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.144920:0:11664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d3a40031e00/0x3de1064d33a8b311 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.144958:0:11664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a7c78ea00/0x3de1064d33a8b1dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8b1d6 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.144973:0:11664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3a7c78ea00/0x3de1064d33a8b1dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8b1d6 expref: 18 pid: 5842 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841950.144987:0:11664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c780000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1875736500690048:0@lo:104: 00000100:00100000:3.0:1788841950.145073:0:11664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788841950.145136:0:11664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a7c78e600/0x3de1064d33a8b1cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8b1c8 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.145144:0:11664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3a7c78e600/0x3de1064d33a8b1cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8b1c8 expref: 18 pid: 5842 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841950.145151:0:11664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c781f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1875736500690176:0@lo:104: 00000100:00100000:3.0:1788841950.145171:0:11664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788841950.145208:0:11664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8b1c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8b1ba expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.145216:0:11664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8b1c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8b1ba expref: 18 pid: 5842 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841950.145224:0:11664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c783100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1875736500690304:0@lo:104: 00000100:00100000:3.0:1788841950.145255:0:11664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788841950.145288:0:11664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a7c78fc00/0x3de1064d33a8b1b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20cd expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.145297:0:11664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d3a7c78fc00/0x3de1064d33a8b1b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20cd expref: 12 pid: 5842 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841950.145308:0:11664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c782d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1875736500690432:192.168.204.55@tcp:104: 00000100:00100000:0.0:1788841950.145618:0:7630:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788841950.145632:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500690048 00000100:00100000:0.0:1788841950.145639:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500690048 00000100:00100000:0.0:1788841950.145683:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500690176 00000100:00100000:0.0:1788841950.145686:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500690176 00000100:00100000:0.0:1788841950.145696:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500690304 00000100:00100000:0.0:1788841950.145699:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500690304 00000100:00100000:0.0:1788841950.145724:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788841950.145732:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788841950.145733:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c781880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:fd738bcb-4fee-4a21-af92-bab36d5458e2+5:11664:x1875736500690048:12345-0@lo:104: 00000100:00100000:2.0:1788841950.145739:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c780e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+5:11664:x1875736500690176:12345-0@lo:104: 00010000:00010000:0.0:1788841950.145745:0:7630:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f000/0x3de1064d33a8b1d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8b1dd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841950.145746:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f200/0x3de1064d33a8b1c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8b1cf expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841950.145800:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788841950.145806:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c780e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+5:11664:x1875736500690176:12345-0@lo:104: Request processed in 67us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841950.145813:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788841950.145831:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788841950.145836:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4ac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+4:11664:x1875736500690304:12345-0@lo:104: 00010000:00010000:2.0:1788841950.145843:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8b1ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8b1c1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.145935:0:11664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a7c6cde00/0x3de1064d33a8b1ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20c6 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.145945:0:11664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d3a7c6cde00/0x3de1064d33a8b1ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20c6 expref: 12 pid: 5845 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841950.145954:0:11664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c780700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1875736500690560:192.168.204.55@tcp:104: 00000100:00100000:3.0:1788841950.146001:0:11664:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4ea5ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788841950.146025:0:11664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c780000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1875736500690048:0@lo:104: 00000100:00100000:3.0:1788841950.146033:0:11664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c781f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1875736500690176:0@lo:104: 00000100:00100000:3.0:1788841950.146040:0:11664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c783100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1875736500690304:0@lo:104: 00010000:00010000:1.0:1788841950.147218:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788841950.147230:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f200/0x3de1064d33a8b1c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8b1cf expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841950.147240:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f200 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:1.0:1788841950.147244:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f200/0x3de1064d33a8b1c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8b1cf expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841950.147255:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f200/0x3de1064d33a8b1c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8b1cf expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841950.147259:0:7630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:00010000:1.0:1788841950.147262:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f200/0x3de1064d33a8b1c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8b1cf expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841950.147267:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788841950.147269:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c781880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:fd738bcb-4fee-4a21-af92-bab36d5458e2+4:11664:x1875736500690048:12345-0@lo:104: Request processed in 1534us (2193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841950.147277:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1788841950.147300:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f200/0x3de1064d33a8b1c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b1cf expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841950.147306:0:8448:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788841950.147307:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788841950.147311:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f000/0x3de1064d33a8b1d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8b1dd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841950.147316:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f000 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:0.0:1788841950.147320:0:8448:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f000/0x3de1064d33a8b1d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8b1dd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841950.147327:0:8448:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f000/0x3de1064d33a8b1d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8b1dd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788841950.147333:0:8448:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f000/0x3de1064d33a8b1d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8b1dd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841950.147338:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f200/0x3de1064d33a8b1c8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b1cf expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841950.147338:0:8448:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788841950.147345:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f200/0x3de1064d33a8b1c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b1cf expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841950.147352:0:8448:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f000/0x3de1064d33a8b1d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b1dd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841950.147356:0:8448:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788841950.147381:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841950.147385:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8b1ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8b1c1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841950.147391:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78e200 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:1.0:1788841950.147394:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8b1ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8b1c1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841950.147400:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8b1ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8b1c1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788841950.147406:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8b1ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8b1c1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841950.147411:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788841950.147426:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8b1ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b1c1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841950.147428:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:1.0:1788841950.147432:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788841950.147435:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4ac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fd738bcb-4fee-4a21-af92-bab36d5458e2+3:11664:x1875736500690304:12345-0@lo:104: Request processed in 1598us (2179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841950.147442:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788841950.147597:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841950.149902:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788841950.149931:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500690688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788841950.150115:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841950.151760:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500690816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788841950.151816:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841950.151849:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788841950.151855:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500690944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788841950.151898:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841950.152076:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500690688 00000100:00100000:3.0:1788841950.152085:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500690688 00010000:00010000:3.0:1788841950.152123:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a7c78e600/0x3de1064d33a8b1cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8b1c8 expref: 19 pid: 5842 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841950.152153:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500690816 00000100:00100000:3.0:1788841950.152156:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500690816 00010000:00010000:3.0:1788841950.152167:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a7c78ea00/0x3de1064d33a8b1dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8b1d6 expref: 20 pid: 5842 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841950.152175:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500690944 00000100:00100000:3.0:1788841950.152178:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500690944 00010000:00010000:3.0:1788841950.152185:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8b1c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8b1ba expref: 21 pid: 5842 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841950.152210:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788841950.152217:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c782a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd738bcb-4fee-4a21-af92-bab36d5458e2+21:3307:x1875736500690688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788841950.152230:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841950.152235:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a7c78e600/0x3de1064d33a8b1cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8b1c8 expref: 21 pid: 5842 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.152245:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a7c78e600/0x3de1064d33a8b1cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8b1c8 expref: 21 pid: 5842 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.152263:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a7c78e600/0x3de1064d33a8b1cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8b1c8 expref: 21 pid: 5842 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.152281:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841950.152316:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c782a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd738bcb-4fee-4a21-af92-bab36d5458e2+20:3307:x1875736500690688:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (2201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841950.152333:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788841950.152351:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788841950.152357:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c781180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3309:x1875736500690816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788841950.152365:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841950.152369:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a7c78ea00/0x3de1064d33a8b1dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8b1d6 expref: 19 pid: 5842 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.152379:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a7c78ea00/0x3de1064d33a8b1dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8b1d6 expref: 19 pid: 5842 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.152390:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a7c78ea00/0x3de1064d33a8b1dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8b1d6 expref: 19 pid: 5842 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.152410:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841950.152438:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c781180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:3309:x1875736500690816:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841950.152444:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788841950.152456:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788841950.152462:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4ec19c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:3309:x1875736500690944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788841950.152470:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841950.152473:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8b1c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8b1ba expref: 17 pid: 5842 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.152482:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8b1c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8b1ba expref: 17 pid: 5842 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.152492:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8b1c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8b1ba expref: 17 pid: 5842 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.152511:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841950.152533:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4ec19c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:3309:x1875736500690944:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841950.152540:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788841950.152625:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500690944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788841950.152634:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500690816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788841950.152692:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841950.152750:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841950.152766:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489121792 00000100:00100000:3.0:1788841950.152770:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489121792 00010000:00010000:3.0:1788841950.152785:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a7c78fc00/0x3de1064d33a8b1b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20cd expref: 13 pid: 5842 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841950.152800:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489121920 00000100:00100000:3.0:1788841950.152803:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489121920 00010000:00010000:3.0:1788841950.152813:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a7c6cde00/0x3de1064d33a8b1ac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20c6 expref: 14 pid: 5845 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841950.152824:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 33 00000100:00100000:3.0:1788841950.152830:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c782a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51360ac4-5eeb-41b7-beab-1dfd58163005+14:2349:x1875736489121792:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788841950.152838:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841950.152842:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a7c78fc00/0x3de1064d33a8b1b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20cd expref: 14 pid: 5842 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.152851:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a7c78fc00/0x3de1064d33a8b1b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20cd expref: 14 pid: 5842 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.152871:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841950.152909:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c782a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51360ac4-5eeb-41b7-beab-1dfd58163005+14:2349:x1875736489121792:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 79us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841950.152915:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 33 00000100:00100000:3.0:1788841950.152928:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 34 00000100:00100000:3.0:1788841950.152934:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c781180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2350:x1875736489121920:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788841950.152940:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841950.152944:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a7c6cde00/0x3de1064d33a8b1ac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20c6 expref: 13 pid: 5845 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.152951:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a7c6cde00/0x3de1064d33a8b1ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20c6 expref: 13 pid: 5845 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.152964:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d3a40031e00/0x3de1064d33a8b311 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.152975:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a40031e00/0x3de1064d33a8b311 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.152991:0:8449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3a40031e00/0x3de1064d33a8b311 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.152998:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3a40031e00/0x3de1064d33a8b311 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.153003:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d3a40031e00/0x3de1064d33a8b311 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.153010:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d3a40031e00/0x3de1064d33a8b311 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.153023:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40031e00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:3.0:1788841950.153027:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d3a40031e00/0x3de1064d33a8b311 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.153036:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d3a40031e00/0x3de1064d33a8b311 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.153056:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d3a40031e00/0x3de1064d33a8b311 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841950.153067:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841950.153101:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c781180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2350:x1875736489121920:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 167us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841950.153108:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 34 00000100:00100000:3.0:1788841950.153230:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500690688:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788841950.153372:0:11664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a7c78fc00/0x3de1064d33a8b1b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20cd expref: 12 pid: 5842 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841950.153385:0:11664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c782d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1875736500690432:192.168.204.55@tcp:104: 00010000:00010000:2.0:1788841950.153395:0:11664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a7c6cde00/0x3de1064d33a8b1ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef20c6 expref: 11 pid: 5845 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841950.153415:0:11664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c780700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1875736500690560:192.168.204.55@tcp:104: 00010000:00010000:2.0:1788841950.153439:0:11664:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d3a40031e00/0x3de1064d33a8b311 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841950.153447:0:11664:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d3a40031e00/0x3de1064d33a8b311 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841950.153452:0:11664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d3a40031e00/0x3de1064d33a8b311 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841950.153458:0:11664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a40031e00/0x3de1064d33a8b311 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841950.157985:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8b1ba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b1c1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841950.158003:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8b1ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b1c1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841950.158217:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f000/0x3de1064d33a8b1d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b1dd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841950.158229:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78f000/0x3de1064d33a8b1d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8b1dd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841950.158278:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841950.158280:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841950.158284:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841950.158947:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841950.158951:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841950.158953:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841951.105982:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841951.844645:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841951.844760:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489122048 00000100:00100000:2.0:1788841951.844773:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489122048 00000100:00100000:2.0:1788841951.844835:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 254 00000100:00100000:2.0:1788841951.844846:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+11:5593:x1875736489122048:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788841951.844862:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841951.844883:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c6cde00/0x3de1064d33a8b318 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef211a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841951.844921:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c6cde00/0x3de1064d33a8b318 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef211a expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841951.844932:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c6cde00/0x3de1064d33a8b318 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef211a expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841951.844953:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cde00, rc 0) 00000100:00100000:2.0:1788841951.845022:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+12:5593:x1875736489122048:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 Request processed in 178us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841951.845029:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 254 00000100:00100000:0.0:1788841951.863169:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841951.865971:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489122176 00000100:00100000:1.0:1788841951.865996:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489122176 00000100:00100000:1.0:1788841951.866114:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 255 00000100:00100000:1.0:1788841951.866127:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a432c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+12:5593:x1875736489122176:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788841951.866561:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a432c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+12:5593:x1875736489122176:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 Request processed in 436us (3408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841951.866571:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 255 00000100:00100000:3.0:1788841951.869425:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841951.869580:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489122304 00000100:00100000:1.0:1788841951.869594:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489122304 00000100:00100000:1.0:1788841951.869753:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 256 00000100:00100000:1.0:1788841951.869778:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+12:5593:x1875736489122304:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788841951.870100:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+12:5593:x1875736489122304:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 Request processed in 335us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841951.870109:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 256 00000100:00100000:1.0:1788841951.878702:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841951.882688:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489122432 00000100:00100000:2.0:1788841951.882744:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489122432 00000100:00100000:2.0:1788841951.882849:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 257 00000100:00100000:2.0:1788841951.882945:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+12:9972:x1875736489122432:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788841951.883745:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+12:9972:x1875736489122432:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 844us (5016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841951.883759:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 257 00000100:00100000:0.0:1788841951.889579:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841951.891512:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489122560 00000100:00100000:1.0:1788841951.891534:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489122560 00000100:00100000:0.0:1788841951.891948:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 258 00000100:00100000:0.0:1788841951.891970:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+12:9972:x1875736489122560:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788841951.892376:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+12:9972:x1875736489122560:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 414us (2872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841951.892385:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 258 00000100:00100000:3.0:1788841951.898341:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841951.898757:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489122688 00000100:00100000:2.0:1788841951.898772:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489122688 00000100:00100000:2.0:1788841951.898845:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 259 00000100:00100000:2.0:1788841951.898858:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+12:5593:x1875736489122688:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788841951.898883:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841951.898908:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c6cc600/0x3de1064d33a8b31f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2121 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841951.898950:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c6cc600/0x3de1064d33a8b31f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2121 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841951.898965:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c6cc600/0x3de1064d33a8b31f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2121 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841951.898975:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cc600, rc 0) 00000100:00100000:2.0:1788841951.899903:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:5593:x1875736489122688:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 Request processed in 1034us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841951.899918:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 259 00000100:00100000:1.0:1788841951.908522:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841951.908764:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489122816 00000100:00100000:0.0:1788841951.908795:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489122816 00000100:00100000:0.0:1788841951.908873:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 260 00000100:00100000:0.0:1788841951.908887:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:5593:x1875736489122816:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788841951.909449:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:5593:x1875736489122816:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 Request processed in 563us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841951.909459:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 260 00000100:00100000:0.0:1788841951.912852:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841951.913428:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489122944 00000100:00100000:1.0:1788841951.913442:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489122944 00000100:00100000:1.0:1788841951.913516:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 261 00000100:00100000:1.0:1788841951.913537:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+13:5593:x1875736489122944:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788841951.913890:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+13:5593:x1875736489122944:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 Request processed in 356us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841951.913900:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 261 00000100:00100000:2.0:1788841951.933304:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841951.934196:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489123072 00000100:00100000:1.0:1788841951.934232:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489123072 00000100:00100000:1.0:1788841951.934324:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 262 00000100:00100000:1.0:1788841951.934339:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:9975:x1875736489123072:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788841951.935248:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:9975:x1875736489123072:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 908us (1971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841951.935260:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 262 00000100:00100000:2.0:1788841951.960652:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841951.960762:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489123200 00000100:00100000:0.0:1788841951.960908:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489123200 00000100:00100000:1.0:1788841951.961079:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 263 00000100:00100000:1.0:1788841951.961093:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:9975:x1875736489123200:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788841951.961441:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:9975:x1875736489123200:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 350us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841951.961451:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 263 10000000:01000000:3.0:1788841952.131239:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788841952.131251:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3944ec2800 from 7 10000000:01000000:3.0:1788841952.131257:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788841952.131326:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8b326 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841952.131342:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8b326 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841952.131355:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8b326 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841952.131417:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c783800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500691072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788841952.131519:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841952.131682:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4ea5a6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788841952.136724:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841952.137485:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500691072 00000100:00100000:0.0:1788841952.137504:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500691072 00000100:00100000:0.0:1788841952.137616:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788841952.137629:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:5847:x1875736500691072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788841952.137650:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841952.137694:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c78e000/0x3de1064d33a8b32d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8b326 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841952.137750:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c78e000/0x3de1064d33a8b32d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8b326 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841952.137764:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c78e000/0x3de1064d33a8b32d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b326 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841952.137776:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78e000, rc 0) 00000100:00100000:0.0:1788841952.137899:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:5847:x1875736500691072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 273us (6379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841952.137906:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788841952.138174:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c783800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500691072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788841952.138198:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8b326 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b32d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841952.138210:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8b326 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b32d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841952.138307:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c783800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500691200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788841952.138351:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841952.138448:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4ea5a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788841952.143961:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500691200 00000100:00100000:1.0:1788841952.143986:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500691200 00000100:00100000:1.0:1788841952.144113:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788841952.144127:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:5847:x1875736500691200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788841952.144596:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:5847:x1875736500691200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 471us (6243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841952.144607:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788841952.145047:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c783800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500691200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788841952.145123:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c783800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500691328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788841952.145199:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841952.145240:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4ea5a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841952.146805:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500691328 00000100:00100000:0.0:1788841952.146820:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500691328 00000100:00100000:0.0:1788841952.146898:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788841952.146909:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:5847:x1875736500691328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788841952.147270:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:5847:x1875736500691328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 362us (2069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841952.147279:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788841952.147539:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c783800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500691328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788841952.148029:0:11677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c783800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:11677:1875736500691456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788841952.148088:0:11677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841952.148195:0:11677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4ea5ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788841952.148322:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500691456 00000100:00100000:1.0:1788841952.148329:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500691456 00000100:00100000:1.0:1788841952.148376:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788841952.148386:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:11677:x1875736500691456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788841952.148591:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:11677:x1875736500691456:12345-0@lo:502:llog_process_th.0 Request processed in 206us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841952.148599:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788841952.151385:0:11677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c783800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:11677:1875736500691456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788841952.151473:0:11677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788841952.151488:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841952.151491:0:11677:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788841952.151498:0:11677:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d3944ec2800 00000020:00000080:3.0:1788841952.151501:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788841952.151632:0:11677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c783800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:11677:1875736500691584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788841952.151763:0:11677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841952.151826:0:11677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4ea5ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788841952.151865:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500691584 00000100:00100000:2.0:1788841952.151875:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500691584 00000100:00100000:2.0:1788841952.151952:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788841952.151964:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:11677:x1875736500691584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788841952.152407:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:11677:x1875736500691584:12345-0@lo:502:llog_process_th.0 Request processed in 444us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841952.152415:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788841952.153335:0:11677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c783800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:11677:1875736500691584:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788841952.153377:0:11677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788841952.153387:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841952.153389:0:11677:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788841952.153394:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788841952.153515:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788841952.153541:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788841952.153554:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8b326 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b32d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841952.153567:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8b326 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b32d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841952.153580:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788841952.153583:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3a4e19d800 from 7 10000000:01000000:1.0:1788841952.153586:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788841952.153628:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43531400/0x3de1064d33a8b334 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841952.153637:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a43531400/0x3de1064d33a8b334 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841952.153647:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a43531400/0x3de1064d33a8b334 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841952.153681:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76211180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500691712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788841952.153760:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841952.153801:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e9b0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788841952.156408:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500691712 00000100:00100000:3.0:1788841952.156426:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500691712 00000100:00100000:3.0:1788841952.156504:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788841952.156517:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:5847:x1875736500691712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788841952.156540:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841952.156565:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8b33b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8b334 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841952.156603:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8b33b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8b334 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841952.156615:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8b33b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b334 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841952.156626:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40030400, rc 0) 00000100:00100000:3.0:1788841952.156758:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500691712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 244us (2997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841952.156766:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788841952.156796:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76211180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500691712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788841952.156818:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a43531400/0x3de1064d33a8b334 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b33b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841952.156829:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a43531400/0x3de1064d33a8b334 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b33b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841952.156924:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76211180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500691840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788841952.156969:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841952.157031:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e9b0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788841952.157102:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500691840 00000100:00100000:2.0:1788841952.157108:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500691840 00000100:00100000:2.0:1788841952.157145:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788841952.157153:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500691840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788841952.157509:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500691840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 356us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841952.157516:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788841952.157673:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76211180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500691840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788841952.157741:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76211180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500691968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788841952.157786:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841952.157832:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500691968 00000100:00100000:3.0:1788841952.157839:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500691968 00000100:00100000:2.0:1788841952.157942:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788841952.157950:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500691968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788841952.171020:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500691968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 13037us (13200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841952.171041:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788841952.172813:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e9b0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788841952.172865:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76211180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500691968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788841952.177978:0:11679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76211180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:11679:1875736500692096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788841952.178106:0:11679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841952.178174:0:11679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e9b0180 going to sleep for 11 seconds 00000100:00100000:2.0:1788841952.180917:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500692096 00000100:00100000:2.0:1788841952.180938:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500692096 00000100:00100000:2.0:1788841952.181067:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788841952.181082:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:11679:x1875736500692096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788841952.181422:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:11679:x1875736500692096:12345-0@lo:502:llog_process_th.0 Request processed in 343us (3315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841952.181430:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788841952.181974:0:11679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76211180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:11679:1875736500692096:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788841952.182031:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788841952.182045:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841952.182048:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788841952.182065:0:11679:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d3a4e19d800 00000020:00000080:1.0:1788841952.182068:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788841952.182203:0:11679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76211180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:11679:1875736500692224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788841952.182267:0:11679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841952.182315:0:11679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e9b0180 going to sleep for 11 seconds 00000100:00100000:2.0:1788841952.186235:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500692224 00000100:00100000:2.0:1788841952.186263:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500692224 00000100:00100000:2.0:1788841952.186355:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788841952.186370:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:11679:x1875736500692224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788841952.186780:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:11679:x1875736500692224:12345-0@lo:502:llog_process_th.0 Request processed in 412us (4511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841952.186788:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788841952.187494:0:11679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76211180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:11679:1875736500692224:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788841952.187543:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788841952.187555:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841952.187558:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788841952.187564:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788841952.190066:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788841952.190290:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788841952.190308:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43531400/0x3de1064d33a8b334 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b33b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841952.190351:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a43531400/0x3de1064d33a8b334 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b33b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841952.190367:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788841952.190371:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3a43e8f800 from 7 10000000:01000000:1.0:1788841952.190373:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788841952.190426:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43530a00/0x3de1064d33a8b342 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841952.190432:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a43530a00/0x3de1064d33a8b342 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841952.190441:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a43530a00/0x3de1064d33a8b342 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841952.190474:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76213800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500692352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788841952.190938:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841952.191022:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e9b06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788841952.191049:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500692352 00000100:00100000:3.0:1788841952.191061:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500692352 00000100:00100000:3.0:1788841952.191133:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788841952.191147:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:5847:x1875736500692352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788841952.191164:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841952.191182:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a40031800/0x3de1064d33a8b349 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8b342 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841952.191214:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a40031800/0x3de1064d33a8b349 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8b342 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841952.191227:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a40031800/0x3de1064d33a8b349 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8b342 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841952.191238:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40031800, rc 0) 00000100:00100000:3.0:1788841952.195877:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:5847:x1875736500692352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 4718us (4925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841952.195896:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788841952.196461:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76213800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500692352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788841952.196500:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a43530a00/0x3de1064d33a8b342 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b349 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841952.196516:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a43530a00/0x3de1064d33a8b342 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b349 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841952.196623:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a80380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500692480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788841952.196703:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841952.198903:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d39456a4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788841952.203020:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500692480 00000100:00100000:1.0:1788841952.203044:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500692480 00000100:00100000:1.0:1788841952.203136:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788841952.203150:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:5847:x1875736500692480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788841952.203581:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:5847:x1875736500692480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 434us (6877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841952.203591:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788841952.203751:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a80380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500692480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788841952.203826:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a80380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500692608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788841952.203888:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841952.203943:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d39456a4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788841952.204017:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500692608 00000100:00100000:1.0:1788841952.204022:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500692608 00000100:00100000:1.0:1788841952.204081:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788841952.204097:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:5847:x1875736500692608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788841952.204283:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:5847:x1875736500692608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841952.204290:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788841952.204517:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a80380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd738bcb-4fee-4a21-af92-bab36d5458e2:5847:1875736500692608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788841952.205503:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a80380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:11682:1875736500692736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788841952.205573:0:11682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841952.205621:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d39456a4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788841952.205683:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500692736 00000100:00100000:1.0:1788841952.205690:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500692736 00000100:00100000:1.0:1788841952.205782:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788841952.205792:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:11682:x1875736500692736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788841952.206019:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:11682:x1875736500692736:12345-0@lo:502:llog_process_th.0 Request processed in 228us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841952.206027:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788841952.206233:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a80380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:11682:1875736500692736:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788841952.206266:0:11682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788841952.206278:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788841952.206281:0:11682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788841952.206290:0:11682:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d3a43e8f800 00000020:00000080:0.0:1788841952.206293:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788841952.206396:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a80380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:11682:1875736500692864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788841952.206438:0:11682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841952.206462:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d39456a4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788841952.207271:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500692864 00000100:00100000:2.0:1788841952.207282:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500692864 00000100:00100000:2.0:1788841952.207331:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788841952.207341:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:11682:x1875736500692864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788841952.208180:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:11682:x1875736500692864:12345-0@lo:502:llog_process_th.0 Request processed in 835us (1736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841952.208191:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788841952.212603:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a80380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd738bcb-4fee-4a21-af92-bab36d5458e2:11682:1875736500692864:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788841952.212675:0:11682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788841952.212691:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788841952.212695:0:11682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788841952.212701:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000040:00080000:2.0:1788841952.213979:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:1.0:1788841952.216568:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788841952.216613:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788841952.216628:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43530a00/0x3de1064d33a8b342 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b349 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841952.216643:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a43530a00/0x3de1064d33a8b342 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b349 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841952.386024:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500692992:0@lo:400:kworker.0 00000100:00100000:1.0:1788841952.386068:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875736500693120:0@lo:400:kworker.0 00000100:00100000:2.0:1788841952.386166:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500693248:0@lo:400:kworker.0 00000100:00100000:1.0:1788841952.386254:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841952.386355:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788841952.386363:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500693504:0@lo:400:kworker.0 00000100:00100000:1.0:1788841952.386397:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841952.386468:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500693504 00000100:00100000:1.0:1788841952.386478:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500693504 00000100:00100000:1.0:1788841952.386555:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788841952.386592:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500693504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841952.386628:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841952.386642:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500693120 00000100:00100000:2.0:1788841952.386671:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788841952.386671:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500693504:12345-0@lo:400:kworker.0 Request processed in 88us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841952.386682:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875736500693376:0@lo:400:kworker.0 00000100:00100000:1.0:1788841952.386686:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788841952.386735:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500693248 00000100:00100000:1.0:1788841952.386740:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500693248 00000100:00100000:2.0:1788841952.386745:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841952.386776:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788841952.386784:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500693248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841952.386875:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500693120 00000100:00100000:3.0:1788841952.386913:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500693376 00000100:00100000:3.0:1788841952.386916:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500693376 00000100:00100000:3.0:1788841952.386939:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788841952.386947:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875736500693120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841952.386973:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500693248:12345-0@lo:400:kworker.0 Request processed in 188us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841952.386982:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788841952.387009:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875736500693120:12345-0@lo:400:kworker.0 Request processed in 50us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841952.387019:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788841952.387038:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00010000:00080000:1.0:1788841952.387040:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7c780700 x1875736500693504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841952.387046:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875736500693376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841952.387055:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500693248:0@lo:400:kworker.0 00000100:00100000:1.0:1788841952.387062:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500693504:0@lo:400:kworker.0 00000100:00100000:1.0:1788841952.387078:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875736500693120:0@lo:400:kworker.0 00000100:00100000:3.0:1788841952.387099:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875736500693376:12345-0@lo:400:kworker.0 Request processed in 53us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841952.387105:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875736500693376:0@lo:400:kworker.0 00000100:00100000:3.0:1788841952.387110:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1788841952.387138:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788841952.387144:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788841952.387146:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788841952.388699:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841952.388880:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500692992 00000100:00100000:3.0:1788841952.388891:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500692992 00000100:00100000:3.0:1788841952.388949:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788841952.388960:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500692992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841952.389095:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500692992:0@lo:400:kworker.0 00000100:00100000:3.0:1788841952.389111:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500692992:12345-0@lo:400:kworker.0 Request processed in 151us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841952.389120:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788841952.898740:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788841952.898788:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500693632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788841952.899024:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841952.899740:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500693632 00000100:00100000:1.0:1788841952.899765:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500693632 00000100:00100000:1.0:1788841952.899847:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788841952.899860:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500693632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788841952.900200:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788841952.900292:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500693632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 435us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841952.900300:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1788841952.900570:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76210a80 x1875736500693632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841952.900598:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500693632:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788841953.155492:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788841953.219705:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788841954.178194:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841954.946383:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500693760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788841954.946487:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841954.946837:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500693760 00000100:00100000:1.0:1788841954.946848:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500693760 00000100:00100000:1.0:1788841954.946970:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788841954.946982:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500693760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788841954.947056:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788841954.947124:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500693760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841954.947132:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1788841954.947506:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788841954.948104:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500693760:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788841955.202640:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841955.241003:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841955.241058:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841955.241096:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841955.241146:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841955.241163:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489123328 00000100:00100000:1.0:1788841955.241176:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489123328 00000100:00100000:1.0:1788841955.241256:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 279 00000100:00100000:1.0:1788841955.241269:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2352:x1875736489123328:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788841955.241367:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2352:x1875736489123328:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 100us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841955.241375:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 279 00000100:00100000:3.0:1788841955.241584:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489123456 00000100:00100000:3.0:1788841955.241589:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489123456 00000100:00100000:3.0:1788841955.241647:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489123712 00000100:00100000:3.0:1788841955.241650:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489123712 00000100:00100000:3.0:1788841955.241683:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 115 00000100:00100000:3.0:1788841955.241692:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2351:x1875736489123456:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841955.241783:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2351:x1875736489123456:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 91us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841955.241790:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 115 00000100:00100000:3.0:1788841955.241805:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 116 00000100:00100000:3.0:1788841955.241812:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2351:x1875736489123712:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841955.241838:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2351:x1875736489123712:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 26us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841955.241844:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 116 00000100:00080000:1.0:1788841955.242409:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788841955.242575:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489123584 00000100:00100000:2.0:1788841955.242584:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489123584 00000100:00100000:2.0:1788841955.242661:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 64 00000100:00100000:2.0:1788841955.242673:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2352:x1875736489123584:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788841955.242764:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2352:x1875736489123584:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 95us (1666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841955.242773:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 64 00000100:00080000:1.0:1788841955.243405:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788841956.226021:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841957.250038:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841957.506319:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875736500694144:0@lo:400:kworker.0 00000100:00100000:1.0:1788841957.506421:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841957.506512:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788841957.506518:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875736500694016:0@lo:400:kworker.0 00000100:00100000:1.0:1788841957.506540:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841957.506554:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500694528:0@lo:400:kworker.0 00000100:00100000:1.0:1788841957.506578:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841957.506616:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500694144 00000100:00100000:1.0:1788841957.506625:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500694144 00000100:00100000:1.0:1788841957.506683:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500694016 00000100:00100000:1.0:1788841957.506686:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500694016 00000100:00100000:1.0:1788841957.506754:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788841957.506764:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875736500694144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841957.506819:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875736500694144:12345-0@lo:400:kworker.0 Request processed in 57us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841957.506827:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788841957.506857:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788841957.506864:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875736500694016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841957.506891:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875736500694016:12345-0@lo:400:kworker.0 Request processed in 28us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841957.506896:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788841957.506926:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500694528 00000100:00100000:1.0:1788841957.506929:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500694528 00000100:00100000:1.0:1788841957.506957:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1788841957.507102:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788841957.507109:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788841957.508182:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500694272:0@lo:400:kworker.0 00000100:00100000:2.0:1788841957.508246:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841957.508267:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500693888:0@lo:400:kworker.0 00000100:00100000:0.0:1788841957.508309:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841957.508312:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500694272 00000100:00100000:2.0:1788841957.508316:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500694272 00000100:00100000:0.0:1788841957.508337:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875736500694400:0@lo:400:kworker.0 00000100:00100000:2.0:1788841957.508361:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788841957.508361:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841957.508370:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500694272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841957.508409:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500694400 00000100:00100000:0.0:1788841957.508413:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500694400 00000100:00100000:2.0:1788841957.508419:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500694272:12345-0@lo:400:kworker.0 Request processed in 52us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841957.508427:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788841957.508443:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788841957.508449:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875736500694400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841957.508451:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500693888 00000100:00100000:2.0:1788841957.508454:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500693888 00000100:00100000:2.0:1788841957.508480:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788841957.508485:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875736500694400:12345-0@lo:400:kworker.0 Request processed in 36us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841957.508490:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788841957.508499:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3310:x1875736500693888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841957.508527:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3310:x1875736500693888:12345-0@lo:400:kworker.0 Request processed in 29us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841957.508528:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875736500694400:0@lo:400:kworker.0 00000100:00100000:2.0:1788841957.508533:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788841957.508548:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500693888:0@lo:400:kworker.0 00000100:00100000:2.0:1788841957.508572:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500694272:0@lo:400:kworker.0 00000100:00100000:0.0:1788841957.508581:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875736500694016:0@lo:400:kworker.0 00000100:00100000:0.0:1788841957.508607:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875736500694144:0@lo:400:kworker.0 00000100:00080000:3.0:1788841957.508661:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788841957.508667:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788841957.508731:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500694528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841957.508788:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500694528:12345-0@lo:400:kworker.0 Request processed in 1825us (2208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841957.508796:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1788841957.509076:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76210700 x1875736500694528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841957.509089:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500694528:0@lo:400:kworker.0 00000100:00100000:3.0:1788841958.018322:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500694656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788841958.018408:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841958.018610:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500694656 00000100:00100000:0.0:1788841958.018619:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500694656 00000100:00100000:0.0:1788841958.018735:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788841958.018745:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500694656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788841958.018779:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788841958.025409:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500694656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6657us (6992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841958.025424:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1788841958.028615:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76210700 x1875736500694656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841958.028647:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500694656:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788841958.278741:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841959.299170:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841960.066499:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788841960.066529:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500694784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788841960.066608:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841960.066860:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500694784 00000100:00100000:1.0:1788841960.066870:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500694784 00000100:00100000:1.0:1788841960.066944:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788841960.066956:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500694784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788841960.066990:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788841960.067040:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500694784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841960.067048:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1788841960.067110:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788841960.067689:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500694784:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788841960.321976:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841960.357164:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841960.357209:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841960.357359:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841960.357396:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841960.357425:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489123840 00000100:00100000:2.0:1788841960.357435:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489123840 00000100:00100000:2.0:1788841960.357485:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 281 00000100:00100000:2.0:1788841960.357494:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2350:x1875736489123840:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788841960.357566:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2350:x1875736489123840:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 72us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841960.357575:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 281 00000100:00100000:0.0:1788841960.357812:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489123968 00000100:00100000:0.0:1788841960.357817:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489123968 00000100:00100000:0.0:1788841960.357872:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489124224 00000100:00100000:0.0:1788841960.357875:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489124224 00000100:00100000:0.0:1788841960.357900:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 120 00000100:00100000:0.0:1788841960.357908:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2350:x1875736489123968:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788841960.357947:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2350:x1875736489123968:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 41us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841960.358116:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 120 00000100:00100000:0.0:1788841960.358131:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 121 00000100:00100000:0.0:1788841960.358138:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489124224:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788841960.358166:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489124224:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 29us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841960.358172:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 121 00000100:00080000:2.0:1788841960.358778:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788841960.359332:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489124096 00000100:00100000:3.0:1788841960.359351:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489124096 00000100:00100000:3.0:1788841960.359419:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 67 00000100:00100000:3.0:1788841960.359429:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2350:x1875736489124096:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841960.359479:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2350:x1875736489124096:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 53us (2082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841960.359486:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 67 00000100:00080000:2.0:1788841960.360914:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788841961.345950:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841962.370065:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841962.627019:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788841962.627052:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500695296:0@lo:400:kworker.0 00000100:00100000:2.0:1788841962.627069:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875736500695168:0@lo:400:kworker.0 00000100:00100000:2.0:1788841962.627133:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841962.627135:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841962.627239:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4926f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500694912:0@lo:400:kworker.0 00000100:00100000:0.0:1788841962.627254:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875736500695424:0@lo:400:kworker.0 00000100:00100000:3.0:1788841962.627272:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841962.627295:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841962.627322:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500695296 00000100:00100000:3.0:1788841962.627330:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500695296 00000100:00100000:0.0:1788841962.627342:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500695168 00000100:00100000:0.0:1788841962.627349:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500695168 00000100:00100000:0.0:1788841962.627396:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500695424 00000100:00100000:3.0:1788841962.627397:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788841962.627401:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500695424 00000100:00100000:3.0:1788841962.627410:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500695296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841962.627448:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788841962.627458:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875736500695168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841962.627472:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500695296:12345-0@lo:400:kworker.0 Request processed in 64us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841962.627480:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788841962.627503:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875736500695168:12345-0@lo:400:kworker.0 Request processed in 47us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841962.627507:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500694912 00000100:00100000:3.0:1788841962.627513:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500694912 00000100:00100000:0.0:1788841962.627515:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788841962.627537:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788841962.627543:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788841962.627547:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875736500695424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841962.627556:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3309:x1875736500694912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841962.627594:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875736500695424:12345-0@lo:400:kworker.0 Request processed in 50us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841962.627600:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3309:x1875736500694912:12345-0@lo:400:kworker.0 Request processed in 46us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841962.627606:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788841962.627611:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:3.0:1788841962.627640:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788841962.627654:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875736500695424:0@lo:400:kworker.0 00000100:00080000:3.0:1788841962.627655:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788841962.627826:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500695296:0@lo:400:kworker.0 00000100:00100000:3.0:1788841962.627835:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4926f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500694912:0@lo:400:kworker.0 00000100:00100000:1.0:1788841962.628054:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4926f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500695040:0@lo:400:kworker.0 00000100:00100000:1.0:1788841962.628106:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841962.628131:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500695552:0@lo:400:kworker.0 00000100:00100000:3.0:1788841962.628153:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500695040 00000100:00100000:1.0:1788841962.628158:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841962.628159:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500695040 00000100:00100000:3.0:1788841962.628190:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788841962.628199:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500695040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841962.628208:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500695552 00000100:00100000:1.0:1788841962.628214:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500695552 00000100:00100000:3.0:1788841962.628247:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500695040:12345-0@lo:400:kworker.0 Request processed in 49us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841962.628255:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788841962.628260:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788841962.628270:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500695552:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788841962.628289:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788841962.628308:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500695552:12345-0@lo:400:kworker.0 Request processed in 41us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841962.628315:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788841962.628346:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4926f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500695040:0@lo:400:kworker.0 00010000:00080000:1.0:1788841962.628359:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a49ade680 x1875736500695552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841962.628369:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500695552:0@lo:400:kworker.0 00000100:00100000:2.0:1788841962.628607:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875736500695168:0@lo:400:kworker.0 00000100:00100000:3.0:1788841963.138177:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500695680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788841963.138250:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841963.139993:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500695680 00000100:00100000:1.0:1788841963.140008:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500695680 00000100:00100000:1.0:1788841963.140091:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788841963.140102:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500695680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788841963.140141:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788841963.140230:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500695680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841963.140237:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1788841963.140400:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76213800 x1875736500695680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841963.140432:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500695680:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788841963.393969:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788841963.462335:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788841964.418005:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841965.186070:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788841965.186112:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500695808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788841965.186211:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841965.186462:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500695808 00000100:00100000:3.0:1788841965.186470:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500695808 00000100:00100000:3.0:1788841965.186540:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788841965.186550:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500695808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788841965.186586:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788841965.186635:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500695808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841965.186642:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1788841965.186705:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788841965.186817:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500695808:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788841965.441914:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841965.478419:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841965.478488:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841965.478571:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489124480 00000100:00100000:3.0:1788841965.478588:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489124480 00000100:00100000:3.0:1788841965.478662:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 125 00000100:00100000:3.0:1788841965.478672:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2349:x1875736489124480:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841965.478782:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2349:x1875736489124480:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 111us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841965.478790:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 125 00000100:00080000:2.0:1788841965.479031:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788841965.479240:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489124352 00000100:00100000:0.0:1788841965.479246:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489124352 00000100:00100000:0.0:1788841965.479279:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 283 00000100:00100000:0.0:1788841965.479287:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2349:x1875736489124352:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788841965.479332:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2349:x1875736489124352:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 45us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841965.479339:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 283 00000100:00100000:2.0:1788841965.501759:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841965.501811:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841965.501985:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489124736 00000100:00100000:0.0:1788841965.502008:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489124736 00000100:00100000:0.0:1788841965.502100:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 126 00000100:00100000:0.0:1788841965.502111:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489124736:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788841965.502192:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489124736:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 83us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841965.502211:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 126 00000100:00100000:3.0:1788841965.502849:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489124608 00000100:00100000:3.0:1788841965.502855:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489124608 00000100:00100000:3.0:1788841965.502908:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 19 00000100:00100000:3.0:1788841965.502916:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2348:x1875736489124608:12345-192.168.204.55@tcp:9:kworker.0 00000020:00000080:3.0:1788841965.502939:0:6695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8b285 00000100:00080000:3.0:1788841965.502948:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8d3a75de2800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788841965.503008:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:1.0:1788841965.503195:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841965.503417:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+2:2348:x1875736489124608:12345-192.168.204.55@tcp:9:kworker.0 Request processed in 500us (1705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841965.503425:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 19 00000100:00080000:2.0:1788841965.503920:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788841965.503925:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788841966.466171:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841967.493749:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841967.746126:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875736500696192:0@lo:400:kworker.0 00000100:00100000:3.0:1788841967.746209:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841967.746287:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788841967.746294:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875736500696064:0@lo:400:kworker.0 00000100:00100000:3.0:1788841967.746319:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841967.746339:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500696576:0@lo:400:kworker.0 00000100:00100000:3.0:1788841967.746365:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841967.746410:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500696192 00000100:00100000:3.0:1788841967.746418:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500696192 00000100:00100000:3.0:1788841967.746485:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500696064 00000100:00100000:3.0:1788841967.746489:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500696064 00000100:00100000:3.0:1788841967.746511:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788841967.746519:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875736500696192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841967.746570:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875736500696192:12345-0@lo:400:kworker.0 Request processed in 51us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841967.746577:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788841967.746593:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788841967.746797:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500696576 00000100:00100000:1.0:1788841967.746808:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500696576 00000100:00100000:1.0:1788841967.746846:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788841967.746854:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500696576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841967.746893:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500696576:12345-0@lo:400:kworker.0 Request processed in 40us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841967.746899:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788841967.746923:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500696320:0@lo:400:kworker.0 00000100:00100000:1.0:1788841967.746950:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841967.746978:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788841967.746983:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500695936:0@lo:400:kworker.0 00000100:00100000:1.0:1788841967.747015:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841967.747033:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875736500696448:0@lo:400:kworker.0 00000100:00100000:1.0:1788841967.747056:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841967.747081:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500696448 00000100:00100000:1.0:1788841967.747084:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500696448 00000100:00080000:2.0:1788841967.747182:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788841967.747187:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788841967.747235:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a4e0b7100 x1875736500696576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841967.747249:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500696576:0@lo:400:kworker.0 00000100:00100000:2.0:1788841967.747263:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875736500696192:0@lo:400:kworker.0 00000100:00100000:2.0:1788841967.747296:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500696320 00000100:00100000:2.0:1788841967.747299:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500696320 00000100:00100000:2.0:1788841967.747330:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788841967.747337:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500696320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841967.747376:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500696320:12345-0@lo:400:kworker.0 Request processed in 39us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841967.747382:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1788841967.747397:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788841967.747459:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875736500696064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841967.747510:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875736500696064:12345-0@lo:400:kworker.0 Request processed in 911us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841967.747516:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788841967.747591:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788841967.747752:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500695936 00000100:00100000:0.0:1788841967.747758:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500695936 00000100:00100000:0.0:1788841967.747791:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788841967.747798:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3309:x1875736500695936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841967.747838:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3309:x1875736500695936:12345-0@lo:400:kworker.0 Request processed in 40us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841967.747844:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788841967.747898:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500695936:0@lo:400:kworker.0 00000100:00100000:0.0:1788841967.747925:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500696320:0@lo:400:kworker.0 00000100:00100000:1.0:1788841967.748025:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875736500696448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841967.748070:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875736500696448:12345-0@lo:400:kworker.0 Request processed in 472us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841967.748077:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788841967.748205:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875736500696064:0@lo:400:kworker.0 00000100:00100000:0.0:1788841967.748284:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875736500696448:0@lo:400:kworker.0 00000100:00100000:2.0:1788841968.261559:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500696704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788841968.261637:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841968.261987:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500696704 00000100:00100000:1.0:1788841968.261996:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500696704 00000100:00100000:1.0:1788841968.262049:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788841968.262060:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500696704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788841968.262103:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788841968.262154:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500696704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841968.262175:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1788841968.263037:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76213800 x1875736500696704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841968.263074:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500696704:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788841968.515117:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788841968.839329:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 090c7b3c-cdb1-4c0e-9553-671552ee3fa2 00000020:00000080:2.0:1788841968.839338:0:6720:0:(genops.c:885:class_export_put()) final put ffff8d3a75de4000/090c7b3c-cdb1-4c0e-9553-671552ee3fa2 00000020:00000080:0.0:1788841968.839399:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a75de4000/090c7b3c-cdb1-4c0e-9553-671552ee3fa2 for lustre-OST0000 00000020:00000080:0.0:1788841968.839457:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3a75de2800 for lustre-OST0000 00010000:00010000:1.0:1788841969.538702:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841970.306514:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500696832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788841970.306610:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841970.306846:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500696832 00000100:00100000:1.0:1788841970.306855:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500696832 00000100:00100000:1.0:1788841970.306936:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1788841970.306948:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788841970.306948:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500696832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788841970.306984:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788841970.307042:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500696832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841970.307049:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788841970.307119:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500696832:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788841970.561955:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841970.596364:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841970.596643:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841970.596702:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841970.596770:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489125120 00000100:00100000:0.0:1788841970.596780:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489125120 00000100:00100000:0.0:1788841970.596844:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489124992 00000100:00100000:0.0:1788841970.596848:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489124992 00000100:00100000:0.0:1788841970.596874:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 130 00000100:00100000:0.0:1788841970.596884:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489125120:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788841970.596933:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 131 00000100:00080000:2.0:1788841970.596938:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788841970.596949:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2350:x1875736489124992:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788841970.596958:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489125120:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 74us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841970.596967:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 130 00000100:00100000:1.0:1788841970.596991:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2350:x1875736489124992:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 47us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841970.596999:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 131 00000100:00100000:3.0:1788841970.598291:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489124864 00000100:00100000:3.0:1788841970.598366:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489124864 00000100:00100000:3.0:1788841970.598473:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 285 00000100:00100000:3.0:1788841970.598483:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2350:x1875736489124864:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841970.598548:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2350:x1875736489124864:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 66us (2197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841970.598555:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 285 00010000:00010000:3.0:1788841971.588568:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841972.609884:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841972.866145:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875736500697216:0@lo:400:kworker.0 00000100:00100000:2.0:1788841972.866221:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841972.866290:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788841972.866297:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875736500697088:0@lo:400:kworker.0 00000100:00100000:2.0:1788841972.866322:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841972.866340:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500697600:0@lo:400:kworker.0 00000100:00100000:2.0:1788841972.866363:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841972.866400:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500697216 00000100:00100000:2.0:1788841972.866407:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500697216 00000100:00100000:2.0:1788841972.866457:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500697088 00000100:00100000:2.0:1788841972.866460:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500697088 00000100:00100000:2.0:1788841972.866479:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788841972.866486:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875736500697216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841972.866546:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875736500697216:12345-0@lo:400:kworker.0 Request processed in 59us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841972.866553:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788841972.866569:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788841972.866575:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875736500697088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841972.866626:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875736500697088:12345-0@lo:400:kworker.0 Request processed in 51us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841972.866631:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788841972.866649:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500697600 00000100:00100000:2.0:1788841972.866652:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500697600 00000100:00100000:2.0:1788841972.866678:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788841972.866685:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500697600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841972.866740:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500697600:12345-0@lo:400:kworker.0 Request processed in 56us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841972.866746:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1788841972.866760:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788841972.866777:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788841972.866804:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875736500697088:0@lo:400:kworker.0 00010000:00080000:2.0:1788841972.866816:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a49adf800 x1875736500697600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841972.866826:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500697600:0@lo:400:kworker.0 00000100:00100000:2.0:1788841972.866835:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875736500697216:0@lo:400:kworker.0 00000100:00100000:3.0:1788841972.867084:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500697344:0@lo:400:kworker.0 00000100:00100000:3.0:1788841972.867119:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841972.867147:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788841972.867153:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500696960:0@lo:400:kworker.0 00000100:00100000:3.0:1788841972.867190:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841972.867213:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875736500697472:0@lo:400:kworker.0 00000100:00100000:3.0:1788841972.867236:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841972.867262:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500697344 00000100:00100000:3.0:1788841972.867266:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500697344 00000100:00100000:3.0:1788841972.867301:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788841972.867308:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500697344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841972.867343:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500697344:12345-0@lo:400:kworker.0 Request processed in 35us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841972.867349:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788841972.867367:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500696960 00000100:00100000:3.0:1788841972.867370:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500696960 00000100:00100000:3.0:1788841972.867393:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788841972.867400:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3309:x1875736500696960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841972.867428:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3309:x1875736500696960:12345-0@lo:400:kworker.0 Request processed in 29us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841972.867434:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788841972.867458:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500697472 00000100:00100000:3.0:1788841972.867461:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500697472 00000100:00100000:3.0:1788841972.867484:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788841972.867491:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875736500697472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841972.867761:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875736500697472:12345-0@lo:400:kworker.0 Request processed in 271us (524us total) trans 0 rc 0/0 00000100:00080000:1.0:1788841972.867913:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788841972.867918:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788841972.868020:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788841972.868053:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500696960:0@lo:400:kworker.0 00000100:00100000:3.0:1788841972.868065:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875736500697472:0@lo:400:kworker.0 00000100:00100000:3.0:1788841972.868085:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500697344:0@lo:400:kworker.0 00000100:00100000:1.0:1788841973.377994:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788841973.378029:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500697728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788841973.378143:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841973.378275:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500697728 00000100:00100000:1.0:1788841973.378288:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500697728 00000100:00100000:1.0:1788841973.378350:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788841973.378360:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500697728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788841973.378432:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788841973.378511:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500697728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841973.378520:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1788841973.378985:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a76210700 x1875736500697728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841989 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841973.379013:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500697728:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788841973.635357:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788841973.706401:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1788841973.911214:0:11842:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 00:32:51 (1788841971) 00010000:00010000:2.0:1788841974.660583:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841975.426491:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788841975.426523:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500697856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788841975.426674:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841975.426936:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500697856 00000100:00100000:1.0:1788841975.426948:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500697856 00000100:00100000:1.0:1788841975.427038:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788841975.427050:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500697856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788841975.427095:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788841975.427158:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500697856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841975.427166:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788841975.427226:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500697856:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788841975.428077:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788841975.591277:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841975.591497:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489125248 00000100:00100000:1.0:1788841975.591511:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489125248 00000100:00080000:3.0:1788841975.591624:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788841975.596760:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 32 00000100:00100000:1.0:1788841975.596799:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:10244:x1875736489125248:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788841975.596828:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841975.596864:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b350 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2128 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.596958:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b357 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.596977:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b357 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.597020:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b357 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788841975.597072:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788841975.597076:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788841975.597299:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b357 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.597332:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b350 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2128 expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.597367:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b357 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2128 expref: 6 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.597376:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a428dfb00) 00010000:00010000:1.0:1788841975.597379:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788841975.597383:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43530400, rc 0) 00000100:00100000:1.0:1788841975.597504:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:10244:x1875736489125248:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 724us (6241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841975.597512:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 32 00000100:00100000:2.0:1788841975.604036:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841975.604219:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489125376 00000100:00100000:3.0:1788841975.604234:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489125376 00000100:00100000:3.0:1788841975.604317:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 33 00000100:00100000:3.0:1788841975.604330:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:10245:x1875736489125376:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788841975.604358:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841975.604386:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8b35e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef212f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841975.604472:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b365 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841975.604490:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b365 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841975.604503:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b365 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841975.604519:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b36c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841975.604527:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b36c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841975.604533:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b36c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841975.604877:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031e00/0x3de1064d33a8b373 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841975.604901:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031e00/0x3de1064d33a8b373 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841975.604908:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031e00/0x3de1064d33a8b373 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788841975.604946:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788841975.604951:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788841975.604985:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031e00/0x3de1064d33a8b373 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841975.604998:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b365 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841975.605006:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b365 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841975.605013:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b365 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841975.605020:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40030c00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841975.605025:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b365 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841975.605033:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b365 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841975.605047:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a428dfb00) 00010000:00010000:3.0:1788841975.605051:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841975.605056:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b365 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841975.605073:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b365 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841975.605091:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b36c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841975.605096:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b36c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841975.605102:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b36c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841975.605107:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40031400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841975.605110:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b36c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841975.605489:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b36c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841975.605502:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d3a821d0200) 00010000:00010000:3.0:1788841975.605506:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841975.605509:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b36c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841975.605516:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b36c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841975.605982:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8b35e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef212f expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841975.606000:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031e00/0x3de1064d33a8b373 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef212f expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841975.606020:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d3a821d0700) 00010000:00010000:3.0:1788841975.606023:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788841975.606026:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40031e00, rc 0) 00000100:00100000:3.0:1788841975.606189:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:10245:x1875736489125376:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 1859us (2169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841975.606199:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 33 00000100:00100000:0.0:1788841975.616231:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841975.616359:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489125632 00000100:00100000:1.0:1788841975.616373:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489125632 00000100:00100000:1.0:1788841975.616453:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 34 00000100:00100000:1.0:1788841975.616465:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:10245:x1875736489125632:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788841975.616494:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841975.616526:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b37a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2136 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.616688:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b381 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.616750:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b381 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.616765:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b381 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.618585:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b388 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.618612:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b388 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.618628:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b388 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.619259:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531000/0x3de1064d33a8b38f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.619272:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531000/0x3de1064d33a8b38f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.619280:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531000/0x3de1064d33a8b38f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788841975.619292:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788841975.619638:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b381 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.619647:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b381 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.619662:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b381 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.619669:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43531e00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788841975.619673:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b381 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.619682:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b381 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.619695:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d3a821d0700) 00010000:00010000:1.0:1788841975.619698:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841975.619702:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b381 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.619936:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b381 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.619955:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b388 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.619960:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b388 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.619965:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b388 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.619970:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43531800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788841975.619973:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b388 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.619988:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b388 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.619997:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d3a428df500) 00010000:00010000:1.0:1788841975.619999:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841975.620002:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b388 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.620007:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b388 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.620752:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b37a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2136 expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.620776:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531000/0x3de1064d33a8b38f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2136 expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841975.620785:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d3a428df000) 00010000:00010000:1.0:1788841975.620789:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841975.620792:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43531000, rc 0) 00000100:00100000:1.0:1788841975.620910:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:10245:x1875736489125632:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 4445us (4694us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788841975.620920:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 34 00000100:00100000:0.0:1788841975.646297:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841975.646494:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489125760 00000100:00100000:2.0:1788841975.646510:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489125760 00000100:00100000:2.0:1788841975.646606:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 35 00000100:00100000:2.0:1788841975.646620:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:10245:x1875736489125760:12345-192.168.204.55@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788841975.646803:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:10245:x1875736489125760:12345-192.168.204.55@tcp:59:lhsmtool_posix.0 Request processed in 185us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841975.646812:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 35 00010000:00010000:3.0:1788841975.683625:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841975.716768:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841975.716842:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841975.716908:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489126016 00000100:00100000:1.0:1788841975.716924:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489126016 00000100:00100000:1.0:1788841975.717018:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 135 00000100:00100000:1.0:1788841975.717030:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489126016:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788841975.717059:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489125888 00000100:00100000:2.0:1788841975.717070:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489125888 00000100:00100000:1.0:1788841975.717144:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489126016:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 115us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841975.717154:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 287 00000100:00100000:1.0:1788841975.717163:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 135 00000100:00100000:2.0:1788841975.717175:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2350:x1875736489125888:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788841975.717412:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2350:x1875736489125888:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 239us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841975.717421:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 287 00000100:00080000:3.0:1788841975.717488:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788841975.748200:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788841976.706861:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841977.730257:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841977.939248:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841977.940955:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489126144 00000100:00100000:0.0:1788841977.940972:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489126144 00000100:00100000:0.0:1788841977.941066:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 36 00000100:00100000:0.0:1788841977.941078:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:10288:x1875736489126144:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1788841977.941102:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841977.941127:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8b39d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef213d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.941233:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8b3a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.941250:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8b3a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.941265:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8b3a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.941280:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8b3ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.941287:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8b3ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.941294:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8b3ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.941545:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8b3a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.941553:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8b3a4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.941559:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8b3a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.941565:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f000 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841977.941570:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8b3a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.941588:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8b3a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.941602:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a428dfb00) 00010000:00010000:0.0:1788841977.941605:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841977.941610:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8b3a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.941617:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8b3a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.941629:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8b3ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.941635:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8b3ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.941642:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8b3ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.941647:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78fe00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841977.941649:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8b3ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.941655:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8b3ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.941661:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d3a4e719900) 00010000:00010000:0.0:1788841977.941664:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841977.941666:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8b3ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.941679:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8b3ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.941737:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8b39d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef213d expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788841977.942287:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788841977.942568:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a428dfb00) 00010000:00010000:0.0:1788841977.942573:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841977.942583:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8b39d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef213d expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.942596:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78e200, rc 0) 00000100:00100000:0.0:1788841977.943324:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:10288:x1875736489126144:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 2243us (4087us total) trans 0 rc 301/301 00000100:00100000:0.0:1788841977.943336:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 36 00000100:00100000:0.0:1788841977.954413:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841977.954526:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489126400 00000100:00100000:2.0:1788841977.954540:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489126400 00000100:00100000:2.0:1788841977.954616:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 37 00000100:00100000:2.0:1788841977.954626:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:10288:x1875736489126400:12345-192.168.204.55@tcp:36:lfs.0 00010000:00010000:2.0:1788841977.954727:0:8623:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788841977.954769:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b357 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2128 expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841977.954803:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a428dfb00) 00010000:00010000:2.0:1788841977.954818:0:8623:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788841977.955125:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b3b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841977.955149:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b3b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841977.955162:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b3b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841977.955176:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b3b9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841977.955183:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b3b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841977.955190:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b3b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841977.956189:0:8623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788841977.956207:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b3b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841977.956216:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b3b2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841977.956223:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b3b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841977.956230:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788841977.956235:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b3b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841977.956243:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b3b2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841977.956269:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a61283700) 00010000:00010000:2.0:1788841977.956271:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788841977.956278:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b3b2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841977.956284:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b3b2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788841977.956306:0:8623:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001861b921 reply state 0000000093c0143f transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b3b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841977.956317:0:8623:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788841977.956471:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+10:10288:x1875736489126400:12345-192.168.204.55@tcp:36:lfs.0 Request processed in 1841us (2067us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788841977.956482:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 37 00010000:00010000:0.0:1788841977.958830:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b3b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.958854:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b3b9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.958862:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b3b9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.958869:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cc000 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841977.958875:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b3b9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.958897:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b3b9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.958920:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d3a61283f00) 00010000:00010000:0.0:1788841977.958923:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841977.958930:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b3b9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841977.958937:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b3b9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841977.987416:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b779f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500698368:0@lo:400:kworker.0 00000100:00100000:3.0:1788841977.987596:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500697984:0@lo:400:kworker.0 00000100:00100000:3.0:1788841977.987654:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841977.987740:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b77b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875736500698496:0@lo:400:kworker.0 00000100:00100000:3.0:1788841977.987781:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841977.987829:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875736500698240:0@lo:400:kworker.0 00000100:00100000:3.0:1788841977.987854:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841977.987875:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788841977.987881:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875736500698112:0@lo:400:kworker.0 00000100:00100000:3.0:1788841977.987904:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841977.987922:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b77a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500698624:0@lo:400:kworker.0 00000100:00100000:3.0:1788841977.988006:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841977.988043:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500697984 00000100:00100000:3.0:1788841977.988069:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500697984 00000100:00100000:3.0:1788841977.988131:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788841977.988151:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3310:x1875736500697984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841977.988209:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3310:x1875736500697984:12345-0@lo:400:kworker.0 Request processed in 59us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841977.988217:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788841977.988253:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500698496 00000100:00100000:3.0:1788841977.988257:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500698496 00000100:00100000:3.0:1788841977.988294:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500698240 00000100:00100000:3.0:1788841977.988297:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500698240 00000100:00100000:3.0:1788841977.988316:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500698112 00000100:00100000:3.0:1788841977.988318:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500698112 00000100:00100000:3.0:1788841977.988332:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788841977.988337:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875736500698496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841977.988369:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875736500698496:12345-0@lo:400:kworker.0 Request processed in 32us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841977.988376:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788841977.988387:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788841977.988393:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875736500698240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841977.988423:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875736500698240:12345-0@lo:400:kworker.0 Request processed in 29us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841977.988428:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788841977.988441:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788841977.988447:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875736500698112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841977.988471:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875736500698112:12345-0@lo:400:kworker.0 Request processed in 24us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841977.988477:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788841977.988778:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500698624 00000100:00100000:3.0:1788841977.988783:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500698624 00000100:00100000:3.0:1788841977.988819:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788841977.988826:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500698624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841977.988861:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500698624:12345-0@lo:400:kworker.0 Request processed in 35us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841977.988867:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1788841977.988887:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788841977.988892:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788841977.988937:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875736500698112:0@lo:400:kworker.0 00010000:00080000:3.0:1788841977.988952:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7b77a300 x1875736500698624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841977.988963:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b77a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500698624:0@lo:400:kworker.0 00000100:00100000:3.0:1788841977.988974:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875736500698240:0@lo:400:kworker.0 00000100:00100000:3.0:1788841977.989010:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500697984:0@lo:400:kworker.0 00000100:00100000:3.0:1788841977.989021:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b77b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875736500698496:0@lo:400:kworker.0 00000100:00100000:0.0:1788841977.989300:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841977.989416:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500698368 00000100:00100000:3.0:1788841977.989421:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500698368 00000100:00100000:3.0:1788841977.989470:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788841977.989477:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b77a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500698368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841977.989548:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b77a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500698368:12345-0@lo:400:kworker.0 Request processed in 71us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841977.989554:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1788841977.989654:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788841977.989678:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b779f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500698368:0@lo:400:kworker.0 00000100:00100000:0.0:1788841978.063530:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841978.063583:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489126528 00000100:00100000:0.0:1788841978.063596:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489126528 00000100:00100000:0.0:1788841978.063670:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 38 00000100:00100000:0.0:1788841978.063683:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:10296:x1875736489126528:12345-192.168.204.55@tcp:101:lctl.0 00010000:00010000:0.0:1788841978.063732:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841978.063763:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8b3c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2144 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.063865:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8b3c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.063882:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8b3c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.063914:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8b3c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788841978.063964:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788841978.063968:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788841978.064015:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8b3c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.064046:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8b3c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2144 expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.067925:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8b3c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2144 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.067949:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a4e719900) 00010000:00010000:0.0:1788841978.067953:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788841978.067958:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78fe00, rc 0) 00000100:00100000:0.0:1788841978.068071:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+10:10296:x1875736489126528:12345-192.168.204.55@tcp:101:lctl.0 Request processed in 4387us (4565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841978.068082:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 38 00000100:00100000:0.0:1788841978.150155:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841978.150246:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489126656 00000100:00100000:3.0:1788841978.150261:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489126656 00000100:00100000:3.0:1788841978.150355:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 39 00000100:00100000:3.0:1788841978.150367:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+10:10302:x1875736489126656:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:3.0:1788841978.150537:0:6963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841978.150567:0:6963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8b3ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef214b expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.150659:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b3d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.150678:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b3d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.150691:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b3d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.150755:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b3dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.150763:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b3dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.150769:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b3dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.150893:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030800/0x3de1064d33a8b3e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.150903:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030800/0x3de1064d33a8b3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.150910:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030800/0x3de1064d33a8b3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788841978.150958:0:6963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788841978.150963:0:6963:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788841978.151014:0:6963:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030800/0x3de1064d33a8b3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.151029:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b3d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.151037:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b3d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.151045:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b3d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.151052:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40031400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841978.151057:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b3d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.151066:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b3d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.151080:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a4e719900) 00010000:00010000:3.0:1788841978.151083:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841978.151088:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b3d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.151095:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b3d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.151112:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b3dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.151130:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b3dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.151137:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b3dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.151141:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40030c00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841978.151146:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b3dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.151152:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b3dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.151160:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d3a821d0200) 00010000:00010000:3.0:1788841978.151162:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841978.151165:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b3dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.151171:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b3dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.151213:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8b3ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef214b expref: 12 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.151228:0:6963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030800/0x3de1064d33a8b3e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef214b expref: 11 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.151235:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:3.0:1788841978.151238:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788841978.151246:0:6963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40030800, rc 0) 00000100:00100000:3.0:1788841978.151326:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+11:10302:x1875736489126656:12345-192.168.204.55@tcp:101:bash.0 Request processed in 961us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841978.151335:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 39 00000100:00100000:0.0:1788841978.155756:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841978.155851:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489126912 00000100:00100000:3.0:1788841978.155865:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489126912 00000100:00100000:3.0:1788841978.155947:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 40 00000100:00100000:3.0:1788841978.155959:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+11:10302:x1875736489126912:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:3.0:1788841978.155989:0:8623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841978.156022:0:8623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052000/0x3de1064d33a8b3ea lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2152 expref: -99 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.156213:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b3f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.156233:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b3f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.156252:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b3f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841978.160276:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b3f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841978.160310:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b3f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841978.160325:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b3f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788841978.162081:0:8623:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788841978.162837:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b3ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841978.162859:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b3ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841978.162891:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b3ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841978.162940:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b3f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841978.162947:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b3f1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841978.162954:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b3f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841978.162960:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788841978.162965:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b3f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841978.162973:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b3f1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841978.162987:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:2.0:1788841978.162990:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788841978.162995:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b3f1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841978.163001:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b3f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788841978.163022:0:8623:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1fbb123 reply state 00000000997e8486 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b3f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841978.163032:0:8623:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788841978.163086:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052000/0x3de1064d33a8b3ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2152 expref: 14 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841978.163102:0:8623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b3ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2152 expref: 13 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841978.163110:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a61283000) 00010000:00010000:2.0:1788841978.163113:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788841978.163115:0:8623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cce00, rc 0) 00000100:00100000:2.0:1788841978.163227:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+14:10302:x1875736489126912:12345-192.168.204.55@tcp:101:bash.0 Request processed in 7268us (7530us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788841978.163238:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 40 00010000:00010000:3.0:1788841978.165238:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b3f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.165258:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b3f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.165266:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b3f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.165272:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841978.165291:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b3f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.165300:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b3f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.165316:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3a61283700) 00010000:00010000:3.0:1788841978.165319:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841978.165324:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b3f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.165330:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b3f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841978.170524:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841978.172201:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489127040 00000100:00100000:3.0:1788841978.172215:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489127040 00000100:00100000:3.0:1788841978.172273:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 20 00000100:00100000:3.0:1788841978.172281:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875736489127040:12345-192.168.204.55@tcp:8:bash.0 00010000:00080000:3.0:1788841978.172316:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 090c7b3c-cdb1-4c0e-9553-671552ee3fa2@192.168.204.55@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:3.0:1788841978.172346:0:6696:0:(genops.c:1385:class_connect()) connect: client 090c7b3c-cdb1-4c0e-9553-671552ee3fa2, cookie 0x3de1064d33a8b40d 00002000:00100000:3.0:1788841978.172359:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 090c7b3c-cdb1-4c0e-9553-671552ee3fa2/ffff8d3a768a9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113972 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788841978.172384:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:2.0:1788841978.174018:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788841978.174091:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8d3a7f1ff800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788841978.175107:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2348:x1875736489127040:12345-192.168.204.55@tcp:8:bash.0 Request processed in 2816us (4584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841978.175123:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 20 00000100:00100000:0.0:1788841978.189994:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841978.190640:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489127168 00000100:00100000:3.0:1788841978.190668:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489127168 00000100:00080000:0.0:1788841978.191089:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788841978.191261:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00100000:3.0:1788841978.191277:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b77aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:0:x1875736489127168:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:3.0:1788841978.191303:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841978.191337:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8b5a7cb/0x3de1064d33a8b414 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2159 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788841978.191394:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788841978.191419:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=306s v=(0 0) 00010000:00010000:3.0:1788841978.191424:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788841978.191436:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8b5a7cb/0x3de1064d33a8b414 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2159 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.191461:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d8b5a7cb/0x3de1064d33a8b414 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2159 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.191479:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60053e00, rc 0) 00000100:00100000:3.0:1788841978.191660:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b77aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:0:x1875736489127168:12345-192.168.204.55@tcp:101:bash.0 Request processed in 378us (1674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841978.191667:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00100000:1.0:1788841978.196340:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841978.196598:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489127296 00000100:00100000:0.0:1788841978.196612:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489127296 00000100:00100000:2.0:1788841978.197093:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 22 00000100:00100000:2.0:1788841978.197109:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:10302:x1875736489127296:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:2.0:1788841978.197133:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841978.197236:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039488c86/0x3de1064d33a8b41b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2160 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841978.197283:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8b5a7cb/0x3de1064d33a8b414 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2159 expref: 8 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841978.197294:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788841978.197320:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788841978.197327:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039488c86/0x3de1064d33a8b41b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2160 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841978.197372:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d8b5a7cb/0x3de1064d33a8b414 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2159 expref: 8 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841978.197389:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d8b5a7cb/0x3de1064d33a8b414 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2159 expref: 8 pid: 6693 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841978.197406:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1875736500698752:192.168.204.55@tcp:104: 00000100:00100000:2.0:1788841978.197583:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a47bff6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788841978.202454:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841978.202561:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489127424 00000100:00100000:3.0:1788841978.202574:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489127424 00010000:00010000:3.0:1788841978.202631:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d8b5a7cb/0x3de1064d33a8b414 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2159 expref: 9 pid: 6693 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841978.202702:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 35 00000100:00100000:3.0:1788841978.202759:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49ade300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:2350:x1875736489127424:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788841978.202785:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841978.202817:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d8b5a7cb/0x3de1064d33a8b414 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2159 expref: 9 pid: 6693 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.202849:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d8b5a7cb/0x3de1064d33a8b414 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2159 expref: 9 pid: 6693 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.202884:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788841978.202889:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788841978.202898:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000039488c86/0x3de1064d33a8b41b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2160 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.202909:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039488c86/0x3de1064d33a8b41b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2160 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.202955:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000039488c86/0x3de1064d33a8b41b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2160 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841978.202972:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4926f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5837:1875736500698880:192.168.204.55@tcp:105: 00000100:00100000:3.0:1788841978.203075:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3944e29a80 going to sleep for 11 seconds 00010000:00010000:0.0:1788841978.206357:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8b5a7cb/0x3de1064d33a8b414 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2159 expref: 9 pid: 6693 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841978.206849:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4926f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5837:1875736500698880:192.168.204.55@tcp:105: 00010000:00010000:3.0:1788841978.206887:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841978.207043:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49ade300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:2350:x1875736489127424:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 4288us (4601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841978.207057:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 35 00000100:00100000:0.0:1788841978.207620:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1875736500698752:192.168.204.55@tcp:104: 00010000:00010000:0.0:1788841978.207654:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039488c86/0x3de1064d33a8b41b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2160 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.207675:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cca00, rc 0) 00000100:00100000:2.0:1788841978.208010:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:10302:x1875736489127296:12345-192.168.204.55@tcp:101:bash.0 Request processed in 10903us (11684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841978.208019:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 22 00000100:00100000:2.0:1788841978.215137:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841978.215221:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489127680 00000100:00100000:3.0:1788841978.215251:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489127680 00000100:00100000:3.0:1788841978.215327:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:3.0:1788841978.215339:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+13:10302:x1875736489127680:12345-192.168.204.55@tcp:35:bash.0 00000100:00100000:3.0:1788841978.215954:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+14:10302:x1875736489127680:12345-192.168.204.55@tcp:35:bash.0 Request processed in 613us (825us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788841978.215965:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:1.0:1788841978.314116:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841978.314360:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489127936 00000100:00100000:0.0:1788841978.314374:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489127936 00000100:00100000:0.0:1788841978.314530:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 41 00000100:00100000:0.0:1788841978.314545:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+14:10312:x1875736489127936:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1788841978.314580:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841978.314609:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b422 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2167 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788841978.314765:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788841978.315066:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b422 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2167 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.315086:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a4e719900) 00010000:00010000:0.0:1788841978.315090:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788841978.315097:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b422 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2167 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.315116:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78f200, rc 0) 00000100:00100000:0.0:1788841978.315307:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+15:10312:x1875736489127936:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 763us (1203us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1788841978.315340:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 41 00000100:00100000:2.0:1788841978.319613:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841978.319745:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489128192 00000100:00100000:3.0:1788841978.319759:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489128192 00000100:00100000:3.0:1788841978.319901:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:3.0:1788841978.319914:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+15:10312:x1875736489128192:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:3.0:1788841978.320744:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+16:10312:x1875736489128192:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 827us (1143us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788841978.320757:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:2.0:1788841978.391534:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841978.395568:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489128320 00000100:00100000:3.0:1788841978.395596:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489128320 00000100:00100000:3.0:1788841978.395789:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 42 00000100:00100000:3.0:1788841978.395806:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+16:10318:x1875736489128320:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1788841978.395845:0:6963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841978.395877:0:6963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b430 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef216e expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.395977:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b437 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.395996:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b437 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.396010:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b437 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788841978.396060:0:6963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788841978.396083:0:6963:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788841978.396112:0:6963:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b437 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.396155:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b430 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef216e expref: 18 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.396180:0:6963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b437 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef216e expref: 17 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.396189:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:3.0:1788841978.396192:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788841978.396196:0:6963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60052a00, rc 0) 00000100:00100000:3.0:1788841978.396292:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+17:10318:x1875736489128320:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 490us (4776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841978.396300:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 42 00000100:00100000:1.0:1788841978.409311:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841978.409471:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489128576 00000100:00100000:2.0:1788841978.409487:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489128576 00000100:00100000:2.0:1788841978.409695:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 43 00000100:00100000:2.0:1788841978.409729:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+17:10318:x1875736489128576:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1788841978.409768:0:8623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841978.413332:0:8623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b43e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2175 expref: -99 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841978.413532:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b445 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841978.413552:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b445 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841978.413567:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b445 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841978.413583:0:8623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788841978.414205:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b43e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2175 expref: 20 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841978.414282:0:8623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b445 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2175 expref: 19 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841978.414292:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a61283000) 00010000:00010000:2.0:1788841978.414295:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788841978.414299:0:8623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cc200, rc 0) 00000100:00100000:2.0:1788841978.414482:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+19:10318:x1875736489128576:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 4773us (5184us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788841978.414494:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 43 00000100:00100000:2.0:1788841978.425305:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841978.425409:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841978.425557:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489128832 00000100:00100000:0.0:1788841978.425573:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489128832 00000100:00100000:0.0:1788841978.425698:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 44 00000100:00100000:0.0:1788841978.425761:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+19:10318:x1875736489128832:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1788841978.425808:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841978.425839:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b453 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef217c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.425984:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b45a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.426002:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b45a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.426015:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b45a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788841978.426029:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788841978.426196:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b453 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef217c expref: 22 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.426221:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b45a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef217c expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.426247:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a61283000) 00010000:00010000:0.0:1788841978.426250:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788841978.426254:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78ea00, rc 0) 00000100:00100000:0.0:1788841978.426349:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+21:10318:x1875736489128832:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 639us (1607us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788841978.426358:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 44 00000100:00100000:1.0:1788841978.426443:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489128960 00000100:00100000:1.0:1788841978.426448:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489128960 00000100:00100000:1.0:1788841978.426493:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 2 00000100:00100000:1.0:1788841978.426514:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+21:2352:x1875736489128960:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788841978.426526:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841978.426544:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b445 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2175 expref: 21 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.426559:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a61283000) 00010000:00010000:1.0:1788841978.426563:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841978.426586:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+20:2352:x1875736489128960:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 74us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841978.426592:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 2 00000100:00100000:0.0:1788841978.447921:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841978.448041:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489129088 00000100:00100000:3.0:1788841978.448056:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489129088 00000100:00100000:3.0:1788841978.448142:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 23 00000100:00100000:3.0:1788841978.448167:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2349:x1875736489129088:12345-192.168.204.55@tcp:1:lfs.0 00010000:00010000:3.0:1788841978.448232:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b468 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.448260:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039488c86/0x3de1064d33a8b41b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2160 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.448270:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788841978.448275:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788841978.448301:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b468 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.448349:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039488c86/0x3de1064d33a8b41b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2160 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.448366:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039488c86/0x3de1064d33a8b41b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2160 expref: 7 pid: 6696 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841978.448382:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4926f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1875736500699008:192.168.204.55@tcp:104: 00000100:00100000:3.0:1788841978.448556:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3944e29240 going to sleep for 11 seconds 00000100:00100000:3.0:1788841978.455475:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4926f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1875736500699008:192.168.204.55@tcp:104: 00010000:00010000:3.0:1788841978.455556:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b468 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841978.463935:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841978.464702:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489129216 00000100:00100000:3.0:1788841978.464737:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489129216 00002000:00100000:3.0:1788841978.464793:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8d3a7b77a300 x1875736489129216/t0(0) o4->090c7b3c-cdb1-4c0e-9553-671552ee3fa2@192.168.204.55@tcp:104/0 lens 504/0 e 0 to 0 dl 1788841989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788841978.464804:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3a7b77a300 with x1875736489129216 ext(0->12) 00010000:00010000:3.0:1788841978.464814:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000039488c86/0x3de1064d33a8b41b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2160 expref: 8 pid: 6696 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.464833:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000039488c86/0x3de1064d33a8b41b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2160 expref: 8 pid: 6696 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788841978.464861:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d3a7b77a300 00000100:00100000:3.0:1788841978.464899:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:3.0:1788841978.464910:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b77a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:2350:x1875736489129216:12345-192.168.204.55@tcp:4:lfs.0 00000100:00100000:1.0:1788841978.501783:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c238000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500699136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788841978.503078:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841978.507098:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500699136 00000100:00100000:3.0:1788841978.507119:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500699136 00000100:00100000:3.0:1788841978.507263:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788841978.507277:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500699136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788841978.507315:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788841978.507429:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500699136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (4353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841978.507436:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788841978.509136:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c238000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500699136:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788841978.542940:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 090c7b3c-cdb1-4c0e-9553-671552ee3fa2 00000001:00080000:0.0:1788841978.566944:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967316 is committed 00000001:00080000:1.0:1788841978.623261:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:0.0:1788841978.623462:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b77a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2350:x1875736489129216:12345-192.168.204.55@tcp:4:lfs.0 Request processed in 158547us (159540us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788841978.623483:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 0 00002000:00100000:0.0:1788841978.623508:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8d3a7b77a300 x1875736489129216/t4294967299(0) o4->090c7b3c-cdb1-4c0e-9553-671552ee3fa2@192.168.204.55@tcp:104/0 lens 504/448 e 0 to 0 dl 1788841989 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788841978.623519:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3a7b77a300 with x1875736489129216 ext(0->12) 00010000:00010000:0.0:1788841978.623531:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000039488c86/0x3de1064d33a8b41b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2160 expref: 7 pid: 6696 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.623552:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000039488c86/0x3de1064d33a8b41b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2160 expref: 7 pid: 6696 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788841978.623559:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d3a7b77a300 00000100:00100000:2.0:1788841978.630103:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841978.631052:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489129344 00000100:00100000:1.0:1788841978.631069:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489129344 00010000:00010000:1.0:1788841978.631121:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039488c86/0x3de1064d33a8b41b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2160 expref: 7 pid: 6696 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841978.631172:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 36 00000100:00100000:1.0:1788841978.631183:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2349:x1875736489129344:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788841978.631199:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788841978.631222:0:5836:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788841978.631225:0:5836:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788841977 00002000:00010000:1.0:1788841978.631228:0:5836:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788841977 00002000:00010000:1.0:1788841978.631230:0:5836:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788841977 00002000:00010000:1.0:1788841978.631232:0:5836:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1788841978.631238:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039488c86/0x3de1064d33a8b41b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2160 expref: 7 pid: 6696 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.631252:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039488c86/0x3de1064d33a8b41b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2160 expref: 7 pid: 6696 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.631278:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039488c86/0x3de1064d33a8b41b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2160 expref: 7 pid: 6696 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.631316:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788841978.631321:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788841978.631327:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b468 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.631337:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b468 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.631381:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841978.631445:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2349:x1875736489129344:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 263us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841978.631454:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 36 00010000:00010000:0.0:1788841978.631547:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b468 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.631558:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b468 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.631582:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b468 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.631599:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b468 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.631608:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b468 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.631616:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052800 already unused, calling callback (ffffffffc1813420) 00010000:00010000:0.0:1788841978.631620:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b468 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.631629:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b468 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.631644:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b468 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.631652:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b468 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841978.631701:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2349:x1875736489129088:12345-192.168.204.55@tcp:1:lfs.0 Request processed in 183538us (183798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841978.631765:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 23 00000100:00100000:1.0:1788841978.647857:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841978.647957:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489129600 00000100:00100000:0.0:1788841978.647967:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489129600 00000100:00100000:0.0:1788841978.648022:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:0.0:1788841978.648044:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+12:10318:x1875736489129600:12345-192.168.204.55@tcp:35:lfs.0 00000004:00010000:0.0:1788841978.648100:0:5853:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b45a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef217c expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788841978.648463:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1788841978.648522:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1788841978.649125:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1788841978.649178:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b46f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.649194:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b3ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2152 expref: 16 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.649203:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b46f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.649247:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b3ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2152 expref: 16 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.649260:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b3ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2152 expref: 16 pid: 8623 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841978.649274:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76808380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1875736500699264:192.168.204.55@tcp:104: 00000100:00100000:0.0:1788841978.649362:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a487ebcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841978.667137:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76808380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1875736500699264:192.168.204.55@tcp:104: 00010000:00010000:0.0:1788841978.667184:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b46f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841978.670693:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841978.672061:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489129728 00000100:00100000:0.0:1788841978.672075:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489129728 00010000:00010000:0.0:1788841978.672125:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b3ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2152 expref: 17 pid: 8623 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841978.672176:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 37 00000100:00100000:0.0:1788841978.672187:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c239f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+17:2351:x1875736489129728:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788841978.672203:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788841978.672209:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b3ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2152 expref: 17 pid: 8623 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.672223:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b3ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2152 expref: 17 pid: 8623 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.672246:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b3ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2152 expref: 17 pid: 8623 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.672264:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a61283000) 00010000:00010000:0.0:1788841978.672270:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b46f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.672279:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b46f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.672287:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b46f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.673040:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788841978.673125:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c239f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+16:2351:x1875736489129728:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 937us (2439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841978.673134:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 37 00010000:00010000:2.0:1788841978.678154:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b46f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841978.678196:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b46f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788841978.678332:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788841978.678558:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1788841978.678663:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c4b3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875736500699392:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788841978.680245:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841978.680335:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7607bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788841978.683031:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500699392 00000100:00100000:0.0:1788841978.683046:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500699392 00000100:00100000:0.0:1788841978.683144:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788841978.683155:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1875736500699392:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788841978.683288:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1875736500699392:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 135us (3049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841978.683295:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788841978.683386:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c4b3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875736500699392:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788841978.684133:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1788841978.684219:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c238e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875736500699520:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788841978.684271:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841978.693213:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788841978.693556:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500699520 00000100:00100000:2.0:1788841978.693567:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500699520 00000100:00100000:3.0:1788841978.693693:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788841978.693705:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c23b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1875736500699520:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788841978.694096:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c23b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5853:x1875736500699520:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 392us (9822us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788841978.694105:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788841978.694363:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c238e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875736500699520:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788841978.694439:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1788841978.694488:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b46f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.694638:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b46f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.694658:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b46f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.694668:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78fc00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788841978.694673:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b46f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.694681:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b46f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.694696:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a61283000) 00010000:00010000:1.0:1788841978.694699:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788841978.694703:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b46f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.694738:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b46f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788841978.694928:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788841978.695173:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788841978.695186:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 306852476032ns, next at 307852473837ns, rc = 0 00000001:00080000:1.0:1788841978.695193:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1788841978.695356:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a61283000) 00010000:00010000:1.0:1788841978.695359:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788841978.695366:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b45a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef217c expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841978.695477:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+19:10318:x1875736489129600:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 47433us (47628us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788841978.695625:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 8 00000020:00080000:1.0:1788841978.695631:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788841978.697773:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841978.698057:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489129856 00000100:00100000:0.0:1788841978.698067:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489129856 00000100:00100000:0.0:1788841978.698128:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 45 00000100:00100000:0.0:1788841978.698140:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c23ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+19:10318:x1875736489129856:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1788841978.698162:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841978.698183:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b476 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2183 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.698243:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b476 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2183 expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.698256:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b476 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2183 expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.698273:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a4e719200) 00010000:00010000:0.0:1788841978.698276:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788841978.698280:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78e800, rc 0) 00000100:00100000:0.0:1788841978.698338:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c23ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+20:10318:x1875736489129856:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 201us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841978.698359:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 45 00000100:00100000:2.0:1788841978.701546:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841978.701628:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489130112 00000100:00100000:3.0:1788841978.701637:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489130112 00000100:00100000:3.0:1788841978.701699:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:3.0:1788841978.701740:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a658dc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+20:10318:x1875736489130112:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:3.0:1788841978.702120:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a658dc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+21:10318:x1875736489130112:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 411us (582us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1788841978.702129:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 9 00010000:00010000:2.0:1788841978.754080:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841978.808652:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841978.808877:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489130368 00000100:00100000:2.0:1788841978.808892:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489130368 00000100:00100000:2.0:1788841978.808982:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 46 00000100:00100000:2.0:1788841978.808995:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+21:10328:x1875736489130368:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1788841978.809029:0:8623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841978.809057:0:8623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8b47d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef218a expref: -99 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841978.809189:0:8623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788841978.809535:0:8623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8b47d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef218a expref: 23 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841978.809555:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a4e719900) 00010000:00010000:2.0:1788841978.809559:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788841978.809566:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8b47d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef218a expref: 23 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841978.809608:0:8623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cd000, rc 0) 00000100:00100000:2.0:1788841978.809845:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+22:10328:x1875736489130368:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 851us (1209us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1788841978.809855:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 46 00000100:00100000:3.0:1788841978.816675:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841978.817170:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489130496 00000100:00100000:0.0:1788841978.817185:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489130496 00000100:00100000:0.0:1788841978.817285:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 47 00000100:00100000:0.0:1788841978.817299:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+22:10328:x1875736489130496:12345-192.168.204.55@tcp:34:lfs.0 00010000:00010000:0.0:1788841978.817483:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b48b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.817517:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b48b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.817533:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b48b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.817552:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b492 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.817559:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.817566:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.817948:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b499 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.821474:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.821520:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788841978.821633:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.821651:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b48b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.821658:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b48b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.821667:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b48b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.821673:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841978.821677:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b48b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.821686:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b48b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.821702:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:0.0:1788841978.821706:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841978.821747:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b48b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.821754:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b48b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.821776:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.821783:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b492 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.821796:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b492 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.821801:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78ec00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841978.821804:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b492 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.821810:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b492 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.821819:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3a4e719c00) 00010000:00010000:0.0:1788841978.821822:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841978.821825:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b492 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.822516:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b492 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.822546:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.822554:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b499 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.822561:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b499 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.822567:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f600 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841978.822570:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b499 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.822593:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b499 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.822607:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a4e719200) 00010000:00010000:0.0:1788841978.822610:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841978.822615:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b499 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841978.822621:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b499 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841978.822826:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+22:10328:x1875736489130496:12345-192.168.204.55@tcp:34:lfs.0 Request processed in 5521us (6159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841978.823969:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 47 00000100:00100000:0.0:1788841978.828991:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841978.832502:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489130752 00000100:00100000:3.0:1788841978.832524:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489130752 00000100:00100000:3.0:1788841978.832687:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:3.0:1788841978.832703:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+22:10328:x1875736489130752:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:3.0:1788841978.833065:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+23:10328:x1875736489130752:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 364us (4087us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1788841978.833074:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:3.0:1788841978.884806:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841978.884946:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489131008 00000100:00100000:1.0:1788841978.884960:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489131008 00000100:00100000:1.0:1788841978.885049:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 48 00000100:00100000:1.0:1788841978.885063:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7681b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+23:10331:x1875736489131008:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1788841978.885173:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841978.885206:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b4a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2191 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.885321:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b4a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.885340:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b4a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.885355:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b4a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.885373:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b4ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.885380:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b4ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.885385:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b4ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.887381:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b4b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.887599:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.887615:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788841978.887631:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788841978.888168:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b4a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.888230:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b4a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.888240:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b4a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.888246:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43530800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788841978.888251:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b4a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.888260:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b4a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.888277:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:1.0:1788841978.888280:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841978.888286:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b4a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.888310:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b4a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.888334:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b4ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.888341:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b4ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.888346:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b4ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.888350:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43530400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788841978.888354:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b4ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.888360:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b4ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.888368:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3a428dfc00) 00010000:00010000:1.0:1788841978.888370:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841978.888373:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b4ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.888378:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b4ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.888620:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b4a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2191 expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.888639:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b4b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2191 expref: 25 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841978.888655:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a4e719200) 00010000:00010000:1.0:1788841978.888657:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788841978.888660:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43531e00, rc 0) 00000100:00100000:1.0:1788841978.888953:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7681b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+25:10331:x1875736489131008:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 3890us (4164us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788841978.888964:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 48 00000100:00100000:0.0:1788841978.893447:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841978.893648:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489131136 00000100:00100000:3.0:1788841978.893662:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489131136 00000100:00100000:3.0:1788841978.893783:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 49 00000100:00100000:3.0:1788841978.893798:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+25:10331:x1875736489131136:12345-192.168.204.55@tcp:54:lfs.0 00010000:00010000:3.0:1788841978.893896:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b4c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.893921:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.893936:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.893973:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.893981:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b4c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.893989:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b4c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.894018:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841978.894024:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b4c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.894033:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b4c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.894048:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a4e719200) 00010000:00010000:3.0:1788841978.894052:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788841978.894058:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b4c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841978.894064:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b4c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841978.894613:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+25:10331:x1875736489131136:12345-192.168.204.55@tcp:54:lfs.0 Request processed in 816us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841978.894625:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 49 00000100:00100000:2.0:1788841978.899274:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841978.899375:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489131392 00000100:00100000:1.0:1788841978.899389:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489131392 00000100:00100000:1.0:1788841978.899503:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:1.0:1788841978.899518:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+25:10331:x1875736489131392:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:1.0:1788841978.900093:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+26:10331:x1875736489131392:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 576us (830us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788841978.900104:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:1.0:1788841979.156231:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841979.156501:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489131648 00000100:00100000:0.0:1788841979.156516:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489131648 00000100:00100000:0.0:1788841979.156634:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 50 00000100:00100000:0.0:1788841979.156648:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c23aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+26:10362:x1875736489131648:12345-192.168.204.55@tcp:101:cat.0 00010000:00010000:0.0:1788841979.156684:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841979.156747:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b4ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2198 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.156892:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b4d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.156910:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b4d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.156944:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b4d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788841979.156959:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00080000:3.0:1788841979.156961:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788841979.157149:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b4ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2198 expref: 29 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.157172:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b4d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2198 expref: 28 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.157183:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a4e719200) 00010000:00010000:0.0:1788841979.157186:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788841979.157191:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78e400, rc 0) 00000100:00100000:0.0:1788841979.157276:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c23aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+28:10362:x1875736489131648:12345-192.168.204.55@tcp:101:cat.0 Request processed in 632us (1063us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788841979.157284:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 50 00000100:00100000:0.0:1788841979.172529:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841979.173057:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841979.173183:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489132032 00000100:00100000:1.0:1788841979.173198:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489132032 00000100:00100000:1.0:1788841979.173303:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 3 00000100:00100000:1.0:1788841979.173318:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4ec19050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+28:2352:x1875736489132032:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788841979.173341:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841979.173527:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b4d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2198 expref: 28 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841979.173564:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a4e719200) 00010000:00010000:1.0:1788841979.173571:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841979.173683:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4ec19050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+27:2352:x1875736489132032:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 367us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841979.173693:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 3 00000100:00100000:3.0:1788841979.175078:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489131904 00000100:00100000:3.0:1788841979.175099:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489131904 00000100:00100000:3.0:1788841979.175336:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:3.0:1788841979.175350:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+27:10362:x1875736489131904:12345-192.168.204.55@tcp:35:cat.0 00000100:00100000:3.0:1788841979.178138:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+28:10362:x1875736489131904:12345-192.168.204.55@tcp:35:cat.0 Request processed in 2773us (5607us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788841979.178162:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:0.0:1788841979.251151:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841979.251296:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489132288 00000100:00100000:1.0:1788841979.251310:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489132288 00000100:00100000:1.0:1788841979.251391:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 51 00000100:00100000:1.0:1788841979.251404:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76809880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+28:10368:x1875736489132288:12345-192.168.204.55@tcp:101:dd.0 00010000:00010000:1.0:1788841979.251449:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841979.251454:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788841979.251919:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b437 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef216e expref: 28 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841979.251947:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:1.0:1788841979.251953:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788841979.251972:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b4df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef219f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841979.252112:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b4e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841979.252131:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b4b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2191 expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841979.252142:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b4e6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841979.252191:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b4b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2191 expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841979.252237:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b4b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2191 expref: 28 pid: 5852 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841979.252257:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c239f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875736500699648:192.168.204.55@tcp:104: 00000100:00100000:1.0:1788841979.252460:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611b600 going to sleep for 11 seconds 00000100:00100000:2.0:1788841979.256378:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841979.256498:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489132416 00000100:00100000:3.0:1788841979.256512:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489132416 00010000:00010000:3.0:1788841979.256584:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b4b5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2191 expref: 29 pid: 5852 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841979.256637:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 38 00000100:00100000:3.0:1788841979.256650:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+29:2349:x1875736489132416:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788841979.256682:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841979.256691:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b4b5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2191 expref: 29 pid: 5852 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.256740:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b4b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2191 expref: 29 pid: 5852 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.256777:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a4e719200) 00010000:00010000:3.0:1788841979.256785:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b4e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.256796:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b4e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.256806:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b4e6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.256830:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841979.256903:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+29:2349:x1875736489132416:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 256us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841979.256912:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 38 00010000:00010000:1.0:1788841979.259412:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b4b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2191 expref: 28 pid: 5852 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841979.259853:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c239f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875736500699648:192.168.204.55@tcp:104: 00010000:00010000:1.0:1788841979.259894:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b4e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841979.259907:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b4e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841979.259915:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b4e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788841979.259944:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788841979.260276:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b4df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef219f expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841979.260297:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b4e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef219f expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841979.260307:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a4e719200) 00010000:00010000:1.0:1788841979.260327:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788841979.260332:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43530400, rc 0) 00000100:00100000:1.0:1788841979.260545:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76809880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+28:10368:x1875736489132288:12345-192.168.204.55@tcp:101:dd.0 Request processed in 9141us (9410us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1788841979.260557:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 51 00000100:00100000:2.0:1788841979.266931:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841979.267033:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489132672 00000100:00100000:0.0:1788841979.267049:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489132672 00000100:00100000:0.0:1788841979.267180:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 52 00000100:00100000:0.0:1788841979.267194:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+28:10368:x1875736489132672:12345-192.168.204.55@tcp:36:dd.0 00010000:00010000:0.0:1788841979.268049:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b4f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.268081:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b4f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.268116:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b4f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788841979.268201:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1788841979.268233:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e54b6201 reply state 00000000704f53d0 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b4f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841979.268243:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788841979.268397:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+31:10368:x1875736489132672:12345-192.168.204.55@tcp:36:dd.0 Request processed in 1202us (1477us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788841979.268406:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 52 00000020:00080000:0.0:1788841979.268412:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788841979.277994:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b4f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.278019:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b4f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.278029:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b4f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.278036:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78ec00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841979.278042:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b4f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.278052:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b4f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.278076:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a4e719200) 00010000:00010000:0.0:1788841979.278079:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841979.278106:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b4f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.278114:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b4f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841979.602217:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841979.602519:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489132800 00000100:00100000:0.0:1788841979.602540:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489132800 00000100:00100000:0.0:1788841979.602833:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 53 00000100:00100000:0.0:1788841979.602848:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+30:10382:x1875736489132800:12345-192.168.204.55@tcp:101:stat.0 00010000:00010000:0.0:1788841979.602884:0:8623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841979.602913:0:8623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b4fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef21a6 expref: -99 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.603007:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b502 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.603027:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b502 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.603041:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b502 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.603061:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8b509 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.603069:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8b509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.603076:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8b509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.603517:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b510 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.603541:0:8623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b4e6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef219f expref: 31 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.603551:0:8623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b510 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.603598:0:8623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b4e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef219f expref: 31 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.603615:0:8623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b4e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef219f expref: 31 pid: 5852 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841979.603632:0:8623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76809f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8623:1875736500699776:192.168.204.55@tcp:104: 00000100:00100000:0.0:1788841979.603943:0:8623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a487eb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788841979.610257:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841979.610349:0:8623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76809f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8623:1875736500699776:192.168.204.55@tcp:104: 00010000:00010000:0.0:1788841979.610395:0:8623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b510 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841979.610493:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489133056 00000100:00100000:2.0:1788841979.610504:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489133056 00000100:00100000:2.0:1788841979.610855:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:2.0:1788841979.610870:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+32:5591:x1875736489133056:12345-192.168.204.55@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788841979.611605:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+33:5591:x1875736489133056:12345-192.168.204.55@tcp:35:ldlm_bl.0 Request processed in 733us (1357us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1788841979.611615:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:2.0:1788841979.614347:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841979.615126:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489133184 00000100:00100000:3.0:1788841979.615141:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489133184 00010000:00010000:3.0:1788841979.615204:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b4e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef219f expref: 33 pid: 5852 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841979.615278:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 39 00000100:00100000:3.0:1788841979.615291:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+33:2349:x1875736489133184:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788841979.615313:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841979.615322:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b4e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef219f expref: 33 pid: 5852 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.615337:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b4e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef219f expref: 33 pid: 5852 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.615368:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b4e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef219f expref: 33 pid: 5852 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.615398:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a4e719200) 00010000:00010000:3.0:1788841979.615405:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b510 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.615415:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.615423:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b510 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.615460:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841979.615593:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+32:2349:x1875736489133184:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 303us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841979.615602:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 39 00010000:00010000:0.0:1788841979.616074:0:8623:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.616085:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788841979.616152:0:8623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788841979.616170:0:8623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788841979.616231:0:8623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.616250:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.616262:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b502 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.616268:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b502 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.616276:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b502 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.616283:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f600 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841979.616288:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b502 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.616297:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b502 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.616311:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:0.0:1788841979.616315:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841979.616320:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b502 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.616327:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b502 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.616340:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8b509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.616357:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8b509 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.616363:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8b509 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.616369:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78fa00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841979.616372:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8b509 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.616379:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8b509 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.616387:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3a4e719c00) 00010000:00010000:0.0:1788841979.616390:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841979.616393:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8b509 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.616400:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8b509 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.616449:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b4fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21a6 expref: 32 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.616466:0:8623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b510 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21a6 expref: 31 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841979.616485:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a4e719200) 00010000:00010000:0.0:1788841979.616488:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788841979.616497:0:8623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78ea00, rc 0) 00000100:00100000:0.0:1788841979.616543:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+31:10382:x1875736489132800:12345-192.168.204.55@tcp:101:stat.0 Request processed in 13698us (14340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841979.616551:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 53 00000100:00100000:2.0:1788841979.681416:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841979.685153:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489133440 00000100:00100000:1.0:1788841979.685178:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489133440 00000100:00100000:1.0:1788841979.685287:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 54 00000100:00100000:1.0:1788841979.685302:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+31:10388:x1875736489133440:12345-192.168.204.55@tcp:36:truncate.0 00010000:00010000:1.0:1788841979.685390:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841979.685429:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b510 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21a6 expref: 31 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841979.685455:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a4e719200) 00010000:00010000:1.0:1788841979.685461:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788841979.685845:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b517 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841979.685863:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b517 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841979.685874:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b517 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788841979.685938:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1788841979.685966:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007beb1f2e reply state 000000007b1085c1 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b517 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841979.685977:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788841979.689145:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+33:10388:x1875736489133440:12345-192.168.204.55@tcp:36:truncate.0 Request processed in 3827us (7726us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788841979.689162:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 54 00000020:00080000:1.0:1788841979.689173:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788841979.696934:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b517 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.696982:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b517 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.696992:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b517 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.697000:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43531800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841979.697006:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b517 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.697016:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b517 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.697040:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a4e719200) 00010000:00010000:3.0:1788841979.697044:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841979.697051:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b517 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.697058:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b517 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.780044:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841979.894407:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841979.894672:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489133568 00000100:00100000:3.0:1788841979.894691:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489133568 00000100:00100000:3.0:1788841979.894815:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 55 00000100:00100000:3.0:1788841979.894833:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+32:10402:x1875736489133568:12345-192.168.204.55@tcp:101:stat.0 00010000:00010000:3.0:1788841979.894864:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841979.894887:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b51e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef21ad expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.894984:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b525 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.894999:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b525 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.895012:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b525 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.895027:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b52c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.895034:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b52c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.895041:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b52c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.895276:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b533 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.895286:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b533 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.895293:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b533 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788841979.896125:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788841979.896132:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788841979.896162:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b533 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.896188:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b533 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.896198:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b525 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.896206:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b525 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.896212:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b525 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.896218:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052a00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841979.896223:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b525 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.896231:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b525 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.896245:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:3.0:1788841979.896248:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841979.896252:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b525 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.896258:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b525 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.896272:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b52c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.896278:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b52c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.896290:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b52c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.896295:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841979.896299:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b52c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.896305:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b52c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.896313:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3a821d0800) 00010000:00010000:3.0:1788841979.896315:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841979.896318:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b52c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.896668:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b52c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.896827:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b51e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21ad expref: 34 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.896845:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b533 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21ad expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841979.896854:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a4e719200) 00010000:00010000:3.0:1788841979.896857:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788841979.896859:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60053e00, rc 0) 00000100:00100000:3.0:1788841979.896928:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+33:10402:x1875736489133568:12345-192.168.204.55@tcp:101:stat.0 Request processed in 2101us (2538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841979.896945:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 55 00000100:00100000:2.0:1788841980.027909:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841980.030492:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489133824 00000100:00100000:0.0:1788841980.030508:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489133824 00000100:00100000:0.0:1788841980.030587:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 56 00000100:00100000:0.0:1788841980.030597:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+33:10412:x1875736489133824:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1788841980.030619:0:8623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841980.030644:0:8623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b53a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef21b4 expref: -99 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788841980.030790:0:8623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788841980.030915:0:8623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b53a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21b4 expref: 35 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841980.030930:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a4e719900) 00010000:00010000:0.0:1788841980.030932:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788841980.030938:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b53a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21b4 expref: 35 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841980.030953:0:8623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78f600, rc 0) 00000100:00100000:0.0:1788841980.031022:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+34:10412:x1875736489133824:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 426us (3130us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1788841980.031029:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 56 00000100:00100000:0.0:1788841980.039929:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841980.042803:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489134080 00000100:00100000:3.0:1788841980.042833:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489134080 00000100:00100000:3.0:1788841980.042961:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 14 00000100:00100000:3.0:1788841980.042975:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+34:10412:x1875736489134080:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:3.0:1788841980.043399:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+35:10412:x1875736489134080:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 425us (3479us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1788841980.043409:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 14 00000100:00100000:2.0:1788841980.125150:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841980.125284:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489134336 00000100:00100000:1.0:1788841980.125300:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489134336 00000100:00100000:1.0:1788841980.125382:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 57 00000100:00100000:1.0:1788841980.125393:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+35:10418:x1875736489134336:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:1.0:1788841980.125424:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841980.125449:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b548 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef21bb expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.125599:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b54f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.125615:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b533 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21ad expref: 36 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.125624:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b54f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.125675:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b533 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21ad expref: 36 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.125691:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b533 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21ad expref: 36 pid: 5851 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841980.125706:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c239180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875736500699904:192.168.204.55@tcp:104: 00000100:00100000:1.0:1788841980.125937:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788841980.133217:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c239180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875736500699904:192.168.204.55@tcp:104: 00010000:00010000:3.0:1788841980.133263:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b54f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841980.133546:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841980.134008:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489134464 00000100:00100000:3.0:1788841980.134019:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489134464 00010000:00010000:2.0:1788841980.134181:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b533 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21ad expref: 37 pid: 5851 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841980.134233:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 40 00000100:00100000:2.0:1788841980.134265:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+37:2350:x1875736489134464:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788841980.134287:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788841980.134297:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b533 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21ad expref: 37 pid: 5851 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.134313:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b533 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21ad expref: 37 pid: 5851 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.134342:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b533 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21ad expref: 37 pid: 5851 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.134370:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a4e719200) 00010000:00010000:2.0:1788841980.134376:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b54f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.134389:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b54f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.134398:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b54f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.134435:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788841980.134519:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+36:2350:x1875736489134464:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 256us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841980.134628:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 40 00010000:00010000:3.0:1788841980.134701:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b54f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.134759:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b54f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788841980.134787:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1788841980.135031:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b548 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21bb expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.135057:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b54f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21bb expref: 36 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.135081:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a4e719200) 00010000:00010000:3.0:1788841980.135084:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788841980.135087:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43531e00, rc 0) 00000100:00100000:3.0:1788841980.135150:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+36:10418:x1875736489134336:12345-192.168.204.55@tcp:101:bash.0 Request processed in 9757us (10015us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1788841980.135158:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 57 00000100:00100000:2.0:1788841980.141842:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841980.142007:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489134720 00000100:00100000:3.0:1788841980.142022:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489134720 00000100:00100000:3.0:1788841980.142100:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 58 00000100:00100000:3.0:1788841980.142124:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+36:10418:x1875736489134720:12345-192.168.204.55@tcp:36:bash.0 00010000:00010000:3.0:1788841980.142517:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b55d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.142555:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b55d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.142570:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b55d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788841980.142634:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1788841980.142662:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b2d4eb82 reply state 000000005a864553 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b55d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841980.142673:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788841980.144403:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+39:10418:x1875736489134720:12345-192.168.204.55@tcp:36:bash.0 Request processed in 2278us (2563us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788841980.144419:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 58 00000020:00080000:2.0:1788841980.144450:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788841980.150216:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841980.150404:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489134848 00000100:00100000:2.0:1788841980.150420:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489134848 00000100:00100000:2.0:1788841980.150533:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 59 00000100:00100000:2.0:1788841980.150548:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c23b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+39:10418:x1875736489134848:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:2.0:1788841980.150583:0:8623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841980.150613:0:8623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b564 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef21c2 expref: -99 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.150767:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b56b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.150789:0:8623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b54f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21bb expref: 40 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.150798:0:8623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b55d lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.150807:0:8623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b56b lrc: 5/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.150829:0:8623:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b55d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.150863:0:8623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b54f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21bb expref: 40 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.150880:0:8623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b54f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21bb expref: 40 pid: 5852 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841980.150925:0:8623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c4b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8623:1875736500700032:192.168.204.55@tcp:104: 00000100:00100000:2.0:1788841980.151033:0:8623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7607b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788841980.154316:0:8623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c4b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8623:1875736500700032:192.168.204.55@tcp:104: 00010000:00010000:3.0:1788841980.154357:0:8623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b56b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841980.154498:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b55d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841980.154515:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b55d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841980.154590:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b55d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841980.154599:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841980.154605:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b55d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841980.154615:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b55d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841980.154637:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a4e719200) 00010000:00010000:0.0:1788841980.154640:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841980.154644:0:3293:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b56b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841980.154657:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b55d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841980.154664:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b55d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841980.155661:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841980.156509:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489134976 00000100:00100000:2.0:1788841980.156521:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489134976 00010000:00010000:2.0:1788841980.156567:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b54f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21bb expref: 40 pid: 5852 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841980.156613:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 41 00000100:00100000:2.0:1788841980.156624:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c239500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+40:2349:x1875736489134976:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788841980.156638:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788841980.156645:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b54f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21bb expref: 40 pid: 5852 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.156659:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b54f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21bb expref: 40 pid: 5852 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.156681:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b54f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21bb expref: 40 pid: 5852 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.156704:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a4e719200) 00010000:00010000:2.0:1788841980.159246:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b56b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.159267:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b56b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.159295:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b56b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.159948:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788841980.160025:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c239500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+39:2349:x1875736489134976:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 3397us (4369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841980.160035:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 41 00010000:00010000:3.0:1788841980.166249:0:8623:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b56b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.166267:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b56b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841980.170973:0:8623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788841980.170984:0:8623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788841980.171024:0:8623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b56b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.171072:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b564 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21c2 expref: 39 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.171552:0:8623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b56b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21c2 expref: 38 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.171564:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a4e719200) 00010000:00010000:2.0:1788841980.171567:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788841980.171571:0:8623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cc000, rc 0) 00000100:00100000:2.0:1788841980.172751:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c23b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+38:10418:x1875736489134848:12345-192.168.204.55@tcp:101:bash.0 Request processed in 22191us (22537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841980.172764:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 59 00000100:00100000:1.0:1788841980.187773:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841980.187871:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489135232 00000100:00100000:3.0:1788841980.187892:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489135232 00000100:00100000:2.0:1788841980.188076:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00100000:2.0:1788841980.188089:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a658dc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+38:10418:x1875736489135232:12345-192.168.204.55@tcp:35:bash.0 00000100:00100000:2.0:1788841980.188356:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a658dc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+39:10418:x1875736489135232:12345-192.168.204.55@tcp:35:bash.0 Request processed in 269us (593us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1788841980.188377:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00100000:0.0:1788841980.314378:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841980.314894:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489135488 00000100:00100000:3.0:1788841980.314909:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489135488 00000100:00100000:3.0:1788841980.314991:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 60 00000100:00100000:3.0:1788841980.315004:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+39:10428:x1875736489135488:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1788841980.315041:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841980.315070:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b572 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef21c9 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788841980.315238:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788841980.317057:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b572 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21c9 expref: 41 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.317084:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a4e719900) 00010000:00010000:3.0:1788841980.317088:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788841980.317095:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b572 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21c9 expref: 41 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.317114:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60052800, rc 0) 00000100:00100000:3.0:1788841980.317314:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+40:10428:x1875736489135488:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 2311us (3018us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1788841980.317348:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 60 00000100:00100000:3.0:1788841980.322233:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841980.325162:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489135616 00000100:00100000:2.0:1788841980.325183:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489135616 00000100:00100000:2.0:1788841980.325270:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 61 00000100:00100000:2.0:1788841980.325282:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+40:10428:x1875736489135616:12345-192.168.204.55@tcp:34:lfs.0 00010000:00010000:2.0:1788841980.325371:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b580 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325390:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b580 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325403:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b580 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325421:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b587 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325429:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325436:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325702:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b58e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325733:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b58e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325741:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b58e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788841980.325795:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b58e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325809:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b580 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325815:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b580 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325822:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b580 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325828:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cc200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788841980.325832:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b580 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325840:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b580 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325852:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:2.0:1788841980.325855:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788841980.325860:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b580 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325865:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b580 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325876:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325882:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b587 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325894:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b587 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325900:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788841980.325903:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b587 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325909:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b587 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325918:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3a61283300) 00010000:00010000:2.0:1788841980.325920:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788841980.325923:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b587 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325928:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b587 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325960:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b58e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325967:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b58e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325972:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b58e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325977:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788841980.325979:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b58e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.325994:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b58e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.326001:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a4e719200) 00010000:00010000:2.0:1788841980.326003:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788841980.326006:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b58e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.326012:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b58e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841980.326098:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+40:10428:x1875736489135616:12345-192.168.204.55@tcp:34:lfs.0 Request processed in 817us (3880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841980.326106:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 61 00000100:00100000:1.0:1788841980.338314:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841980.339943:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489135872 00000100:00100000:2.0:1788841980.339959:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489135872 00000100:00100000:2.0:1788841980.340029:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:2.0:1788841980.340040:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c23b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+40:10428:x1875736489135872:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:2.0:1788841980.340311:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c23b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+41:10428:x1875736489135872:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 272us (2007us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788841980.340320:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:0.0:1788841980.379314:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841980.379479:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489136128 00000100:00100000:2.0:1788841980.379489:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489136128 00000100:00100000:2.0:1788841980.379549:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 62 00000100:00100000:2.0:1788841980.379559:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7680b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+41:10431:x1875736489136128:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1788841980.379584:0:8623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841980.379603:0:8623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b595 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef21d0 expref: -99 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.379687:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b59c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.379701:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b59c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.379830:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b59c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.379848:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b5a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.379856:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.379862:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.380169:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b5aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.380179:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b5aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.380187:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b5aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841980.380200:0:8623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788841980.380283:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b59c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.380290:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b59c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.380302:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b59c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.380309:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788841980.380313:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b59c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.380320:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b59c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.380332:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:2.0:1788841980.380335:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788841980.380339:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b59c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.380345:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b59c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.380358:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.380364:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b5a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.380370:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.380376:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cc200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788841980.380379:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.380395:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b5a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.380404:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3a61283300) 00010000:00010000:2.0:1788841980.380406:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788841980.380409:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b5a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.380414:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b5a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.380470:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b595 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21d0 expref: 44 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.380484:0:8623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b5aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21d0 expref: 43 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.380491:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a4e719200) 00010000:00010000:2.0:1788841980.380493:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788841980.380495:0:8623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cda00, rc 0) 00000100:00100000:2.0:1788841980.380556:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7680b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+43:10431:x1875736489136128:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 998us (1252us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788841980.380563:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 62 00000100:00100000:3.0:1788841980.384415:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841980.385121:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489136256 00000100:00100000:1.0:1788841980.385132:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489136256 00000100:00100000:1.0:1788841980.385200:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 63 00000100:00100000:1.0:1788841980.385210:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+43:10431:x1875736489136256:12345-192.168.204.55@tcp:54:lfs.0 00010000:00010000:1.0:1788841980.385285:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b5b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.385302:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b5b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.385312:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b5b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.385338:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b5b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.385345:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b5b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.385351:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b5b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.385357:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43530400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788841980.385360:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b5b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.385368:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b5b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.385395:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a4e719200) 00010000:00010000:1.0:1788841980.385397:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788841980.385402:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b5b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.385408:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b5b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841980.385510:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+43:10431:x1875736489136256:12345-192.168.204.55@tcp:54:lfs.0 Request processed in 301us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841980.385518:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 63 00000100:00100000:3.0:1788841980.386011:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841980.386041:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489136384 00000100:00100000:3.0:1788841980.386045:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489136384 00000100:00100000:3.0:1788841980.386083:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 4 00000100:00100000:3.0:1788841980.386091:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49adea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+43:2351:x1875736489136384:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788841980.386102:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841980.386136:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b5aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21d0 expref: 43 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.386149:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a4e719200) 00010000:00010000:3.0:1788841980.386153:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841980.386175:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49adea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+42:2351:x1875736489136384:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 86us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841980.386182:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 4 00000100:00100000:3.0:1788841980.390155:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841980.391870:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489136640 00000100:00100000:2.0:1788841980.391885:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489136640 00000100:00100000:2.0:1788841980.391948:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:2.0:1788841980.391959:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+42:10431:x1875736489136640:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:2.0:1788841980.392210:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+43:10431:x1875736489136640:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 252us (2064us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788841980.392218:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:1.0:1788841980.547331:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788841980.553286:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500700160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788841980.553367:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841980.556722:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500700160 00000100:00100000:3.0:1788841980.556740:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500700160 00000100:00100000:3.0:1788841980.556899:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788841980.556909:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500700160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788841980.556945:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788841980.557039:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500700160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (3672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841980.557046:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788841980.558129:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500700160:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788841980.559626:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788841980.612505:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841980.612736:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489136896 00000100:00100000:3.0:1788841980.612755:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489136896 00000100:00100000:3.0:1788841980.612820:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 64 00000100:00100000:3.0:1788841980.612830:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c23bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+43:10449:x1875736489136896:12345-192.168.204.55@tcp:101:cat.0 00010000:00010000:3.0:1788841980.612858:0:6963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841980.612883:0:6963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b5bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef21d7 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.612987:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b5c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.613002:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b5c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.613013:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b5c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788841980.613025:0:6963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788841980.613148:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b5bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21d7 expref: 46 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.613173:0:6963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b5c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21d7 expref: 45 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.613182:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a4e719200) 00010000:00010000:3.0:1788841980.613185:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788841980.613188:0:6963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60052a00, rc 0) 00000100:00100000:3.0:1788841980.613412:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c23bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+45:10449:x1875736489136896:12345-192.168.204.55@tcp:101:cat.0 Request processed in 581us (916us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788841980.613419:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 64 00000100:00100000:3.0:1788841980.642878:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841980.643001:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489137024 00000100:00100000:2.0:1788841980.643014:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489137024 00000100:00100000:2.0:1788841980.643084:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 65 00000100:00100000:2.0:1788841980.643095:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+45:10450:x1875736489137024:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1788841980.643129:0:8623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841980.643150:0:8623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b5d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef21de expref: -99 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.643218:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b5db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.643232:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b5db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.643244:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b5db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841980.643277:0:8623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788841980.643281:0:8623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788841980.643295:0:8623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b5db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.643319:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b5d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21de expref: 47 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.643357:0:8623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b5db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21de expref: 46 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.643366:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:2.0:1788841980.643369:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788841980.643373:0:8623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cc200, rc 0) 00000100:00100000:2.0:1788841980.643435:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+46:10450:x1875736489137024:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 342us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841980.643442:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 65 00000100:00100000:1.0:1788841980.649831:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841980.650486:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489137408 00000100:00100000:2.0:1788841980.650497:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489137408 00000100:00100000:2.0:1788841980.650558:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 18 00000100:00100000:2.0:1788841980.650569:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c23a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+46:10450:x1875736489137408:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:2.0:1788841980.651080:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c23a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+47:10450:x1875736489137408:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 510us (1261us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788841980.651088:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 18 00000100:00100000:3.0:1788841980.653623:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841980.653756:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489137536 00000100:00100000:1.0:1788841980.653766:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489137536 00000100:00100000:1.0:1788841980.653834:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 5 00000100:00100000:1.0:1788841980.653845:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+47:10450:x1875736489137536:12345-192.168.204.55@tcp:103:lfs.0 00010000:00010000:1.0:1788841980.653861:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788841980.653889:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b56b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21c2 expref: 47 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.653913:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b5c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21d7 expref: 46 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.653949:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b476 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2183 expref: 45 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.653959:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a4e719200) 00010000:00010000:1.0:1788841980.653969:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841980.654017:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+44:10450:x1875736489137536:12345-192.168.204.55@tcp:103:lfs.0 Request processed in 175us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841980.654025:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 5 00000100:00100000:0.0:1788841980.656690:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841980.657076:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489137664 00000100:00100000:2.0:1788841980.657087:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489137664 00000100:00100000:2.0:1788841980.657253:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 66 00000100:00100000:2.0:1788841980.657264:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7680ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+44:10450:x1875736489137664:12345-192.168.204.55@tcp:58:lfs.0 00010000:00010000:2.0:1788841980.657401:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b5e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.657420:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b5e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.657443:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b5e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788841980.657903:0:5851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788841980.658266:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788841980.658338:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788841980.658506:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7680ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+44:10450:x1875736489137664:12345-192.168.204.55@tcp:58:lfs.0 Request processed in 1242us (1823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841980.658517:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 66 00000100:00100000:0.0:1788841980.694317:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841980.694395:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489137792 00000100:00100000:3.0:1788841980.694404:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489137792 00000100:00100000:3.0:1788841980.694467:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 67 00000100:00100000:3.0:1788841980.694477:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+44:10452:x1875736489137792:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1788841980.694497:0:6963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841980.694516:0:6963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b5e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef21e5 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.694590:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052000/0x3de1064d33a8b5f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.694605:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052000/0x3de1064d33a8b5f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.694615:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052000/0x3de1064d33a8b5f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.694629:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b5f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.694636:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.694642:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.694892:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b5fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.694900:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b5fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.694913:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b5fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788841980.694947:0:6963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788841980.694951:0:6963:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788841980.694967:0:6963:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b5fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.694978:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b5fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.694986:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052000/0x3de1064d33a8b5f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.694992:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052000/0x3de1064d33a8b5f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.694999:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052000/0x3de1064d33a8b5f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.695004:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052000 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841980.695008:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052000/0x3de1064d33a8b5f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.695016:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052000/0x3de1064d33a8b5f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.695027:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:3.0:1788841980.695030:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841980.695034:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052000/0x3de1064d33a8b5f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.695050:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052000/0x3de1064d33a8b5f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.695062:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.695068:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b5f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.695073:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b5f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.695078:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841980.695080:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b5f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.695086:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b5f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.695093:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3a821d0800) 00010000:00010000:3.0:1788841980.695095:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841980.695097:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b5f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.695102:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b5f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.695132:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b5e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21e5 expref: 46 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.695143:0:6963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b5fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21e5 expref: 45 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.695154:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a61283300) 00010000:00010000:3.0:1788841980.695156:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788841980.695159:0:6963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60052a00, rc 0) 00000100:00100000:3.0:1788841980.695209:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+45:10452:x1875736489137792:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 733us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841980.695216:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 67 00010000:00010000:1.0:1788841980.801874:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841980.847446:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841980.847500:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841980.847551:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841980.847650:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489138048 00000100:00100000:0.0:1788841980.847671:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489138048 00000100:00100000:0.0:1788841980.847789:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 76 00000100:00100000:0.0:1788841980.847800:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2350:x1875736489138048:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788841980.847879:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2350:x1875736489138048:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 82us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841980.847888:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 76 00000100:00080000:2.0:1788841980.848404:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788841980.848529:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489138176 00000100:00100000:3.0:1788841980.848535:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489138176 00000100:00100000:3.0:1788841980.848589:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 139 00000100:00100000:3.0:1788841980.848597:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489138176:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841980.848640:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489138176:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 45us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841980.848646:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 139 00000100:00080000:2.0:1788841980.848701:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788841980.848787:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489137920 00000100:00100000:1.0:1788841980.848792:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489137920 00000100:00100000:1.0:1788841980.848828:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 289 00000100:00100000:1.0:1788841980.848835:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2350:x1875736489137920:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788841980.848861:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2350:x1875736489137920:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 27us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841980.848867:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 289 00000040:00080000:2.0:1788841980.866024:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788841980.866035:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788841980.866087:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788841980.866094:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788841980.866365:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c4b1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11681:1875736500700288:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788841980.867508:0:11681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7607b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788841980.880170:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c4b1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11681:1875736500700288:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788841980.890691:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841980.890900:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489138304 00000100:00100000:1.0:1788841980.890910:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489138304 00000100:00100000:1.0:1788841980.890968:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 1 00000100:00100000:1.0:1788841980.890979:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7680aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+45:10463:x1875736489138304:12345-192.168.204.55@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788841980.891075:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7680aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+45:10463:x1875736489138304:12345-192.168.204.55@tcp:900:lhsmtool_posix.0 Request processed in 99us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841980.891084:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 1 00000100:00100000:0.0:1788841980.894241:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841980.894330:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489138432 00000100:00100000:3.0:1788841980.894341:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489138432 00000100:00100000:3.0:1788841980.894399:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 68 00000100:00100000:3.0:1788841980.894410:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+45:10463:x1875736489138432:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788841980.894442:0:5851:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788841980.894697:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+45:10463:x1875736489138432:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 Request processed in 165us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841980.894742:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 68 00000100:00100000:3.0:1788841980.904069:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841980.906803:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489138560 00000100:00100000:2.0:1788841980.906825:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489138560 00000100:00100000:2.0:1788841980.906930:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 69 00000100:00100000:2.0:1788841980.906945:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c476d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+45:10463:x1875736489138560:12345-192.168.204.55@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788841980.907058:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b605 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.907102:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b605 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.907121:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b605 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.907142:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b60c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.907150:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b60c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.907157:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b60c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.910691:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b613 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.910745:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.910761:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841980.910829:0:8623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788841980.910835:0:8623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788841980.910858:0:8623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.910874:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b605 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.910907:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b605 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.910915:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b605 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.910922:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788841980.910928:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b605 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.910938:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b605 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.910954:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d3a428df000) 00010000:00010000:2.0:1788841980.910958:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788841980.910964:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b605 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.910971:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b605 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.910993:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b60c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.910999:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b60c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.911006:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b60c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.911011:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cc000 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788841980.911021:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b60c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.911028:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b60c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.911038:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8d3a61283400) 00010000:00010000:2.0:1788841980.911040:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788841980.911044:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b60c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.911050:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b60c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.911070:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.911077:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b613 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.911083:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b613 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.911089:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cda00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788841980.911091:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b613 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.911098:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b613 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.911106:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a61283300) 00010000:00010000:2.0:1788841980.911108:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788841980.911122:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b613 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.911128:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b613 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841980.911270:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c476d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+45:10463:x1875736489138560:12345-192.168.204.55@tcp:34:lhsmtool_posix.0 Request processed in 4320us (7207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841980.911283:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 69 00000100:00100000:0.0:1788841980.917466:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841980.917634:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489138816 00000100:00100000:1.0:1788841980.917655:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489138816 00000100:00100000:1.0:1788841980.917768:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 70 00000100:00100000:1.0:1788841980.917782:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7680b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+45:10463:x1875736489138816:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788841980.917816:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841980.917847:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b61a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef21ec expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.918009:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b621 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.918029:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b621 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.918045:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b621 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788841980.918060:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788841980.929883:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b621 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.929907:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b621 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.929917:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b621 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.929924:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43530800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788841980.929929:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b621 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.929938:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b621 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.929976:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a61283300) 00010000:00010000:1.0:1788841980.929979:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788841980.929986:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b621 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.929992:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b621 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.930081:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b61a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21ec expref: 47 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.930095:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d3a428df000) 00010000:00010000:1.0:1788841980.930098:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788841980.930102:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b61a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21ec expref: 47 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841980.930115:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43531800, rc 0) 00000100:00100000:1.0:1788841980.934272:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7680b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+46:10463:x1875736489138816:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 16472us (16811us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1788841980.934291:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 70 00000100:00100000:0.0:1788841980.943089:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841980.945249:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489138944 00000100:00100000:3.0:1788841980.945271:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489138944 00000100:00100000:3.0:1788841980.945362:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 71 00000100:00100000:3.0:1788841980.945573:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+46:10463:x1875736489138944:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788841980.945648:0:6963:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788841980.946970:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+46:10463:x1875736489138944:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 Request processed in 1394us (3888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841980.946983:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 71 00000100:00100000:1.0:1788841980.956200:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841980.956328:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489139200 00000100:00100000:3.0:1788841980.956338:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489139200 00000100:00100000:3.0:1788841980.956398:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 72 00000100:00100000:3.0:1788841980.956411:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c23a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+46:10463:x1875736489139200:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788841980.956435:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841980.956439:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788841980.956480:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8b5db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21de expref: 46 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841980.956502:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:3.0:1788841980.956506:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788841980.956521:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b62f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef21f3 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788841980.957461:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1788841980.959474:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b636 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.959505:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.959520:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.959612:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b62f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21f3 expref: 48 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.959637:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b636 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21f3 expref: 47 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.959647:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d3a61283400) 00010000:00010000:2.0:1788841980.959650:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788841980.959655:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cda00, rc 0) 00000100:00100000:2.0:1788841980.959810:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c23a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+47:10463:x1875736489139200:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 3401us (3617us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788841980.959821:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 72 00000100:00100000:1.0:1788841980.971833:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841980.971907:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489139456 00000100:00100000:2.0:1788841980.971924:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489139456 00000100:00100000:2.0:1788841980.972004:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 73 00000100:00100000:2.0:1788841980.972016:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+47:10463:x1875736489139456:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788841980.972780:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788841980.972824:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b636 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21f3 expref: 47 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.972853:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d3a61283400) 00010000:00010000:2.0:1788841980.972868:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788841980.972903:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b644 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.972921:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b644 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.972933:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b644 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.976460:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b64b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xf77b6f98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.976486:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b64b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf77b6f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.976499:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b64b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf77b6f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.977428:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b644 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.977442:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b644 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.977462:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b644 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.977467:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cc000 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788841980.977472:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b644 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.977482:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b644 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.977498:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:2.0:1788841980.977501:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788841980.977506:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b644 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.977512:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b644 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.977527:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b64b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf77b6f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.977533:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b64b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf77b6f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.977539:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b64b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf77b6f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.977554:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788841980.977557:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b64b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf77b6f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.977564:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b64b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf77b6f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.977587:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf77b6f98 (ffff8d3a61283a00) 00010000:00010000:2.0:1788841980.977589:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788841980.977592:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b64b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf77b6f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.977598:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b64b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf77b6f98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841980.978122:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+46:10463:x1875736489139456:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 6103us (6296us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788841980.978134:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 73 00000100:00100000:1.0:1788841980.985336:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841980.985419:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489139584 00000100:00100000:2.0:1788841980.985430:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489139584 00000100:00100000:2.0:1788841980.985508:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 74 00000100:00100000:2.0:1788841980.985521:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+46:10463:x1875736489139584:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788841980.985545:0:6963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841980.985588:0:6963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b652 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef21fa expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.985623:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8b659 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.985655:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8b659 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.985678:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8b659 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.986396:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b652 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21fa expref: 48 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.986419:0:6963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8b659 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21fa expref: 47 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.986428:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d3a61283200) 00010000:00010000:2.0:1788841980.986431:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788841980.986434:0:6963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cdc00, rc 0) 00000100:00100000:2.0:1788841980.986509:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+47:10463:x1875736489139584:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 991us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841980.986516:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 74 00000100:00100000:1.0:1788841980.990393:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841980.990500:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489139840 00000100:00100000:2.0:1788841980.990518:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489139840 00000100:00100000:2.0:1788841980.990684:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 75 00000100:00100000:2.0:1788841980.990695:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+47:10463:x1875736489139840:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788841980.990839:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8b660 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.990856:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8b660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841980.990890:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8b660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788841980.991232:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:2.0:1788841980.991242:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 309148532645ns, next at 310148530365ns, rc = 0 00000004:00010000:2.0:1788841980.997111:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a148dda reply state 00000000e67f3cb5 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8b660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841980.997128:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788841980.997384:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+49:10463:x1875736489139840:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 6686us (6996us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1788841980.997393:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 75 00010000:00010000:3.0:1788841981.000988:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8b660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.001007:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8b660 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.001016:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8b660 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.001024:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cc400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841981.001029:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8b660 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.001054:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8b660 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.001074:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d3a61283200) 00010000:00010000:3.0:1788841981.001076:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788841981.001082:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8b660 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.001088:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8b660 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841981.004961:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841981.005148:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489139968 00000100:00100000:2.0:1788841981.005157:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489139968 00000100:00100000:2.0:1788841981.005230:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 76 00000100:00100000:2.0:1788841981.005240:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+48:10463:x1875736489139968:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00000100:00080000:0.0:1788841981.005671:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788841981.005701:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841981.005751:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b667 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2201 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.006350:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b667 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2201 expref: 49 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.006368:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b667 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2201 expref: 49 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.006391:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d3a61283200) 00010000:00010000:2.0:1788841981.006746:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788841981.006750:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cd200, rc 0) 00000100:00100000:2.0:1788841981.006917:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+49:10463:x1875736489139968:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 1677us (1965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841981.006926:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 76 00000100:00100000:1.0:1788841981.013034:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841981.013124:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489140096 00000100:00100000:3.0:1788841981.013134:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489140096 00000100:00100000:3.0:1788841981.013186:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 24 00000100:00100000:3.0:1788841981.013194:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c238000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1875736489140096:12345-192.168.204.55@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788841981.013224:0:8622:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 090c7b3c-cdb1-4c0e-9553-671552ee3fa2@192.168.204.55@tcp t0 exp 0000000000000000 cur 309 last 0 00000020:00000080:3.0:1788841981.013258:0:8622:0:(genops.c:1385:class_connect()) connect: client 090c7b3c-cdb1-4c0e-9553-671552ee3fa2, cookie 0x3de1064d33a8b66e 00002000:00100000:3.0:1788841981.013270:0:8622:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 090c7b3c-cdb1-4c0e-9553-671552ee3fa2/ffff8d3a768a9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113972 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788841981.013280:0:8622:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:3.0:1788841981.013522:0:8622:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788841981.013996:0:8622:0:(import.c:65:import_set_state_nolock()) ffff8d3a768ae800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788841981.014067:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c238000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2348:x1875736489140096:12345-192.168.204.55@tcp:8:lhsmtool_posix.0 Request processed in 870us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841981.014075:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 24 00000100:00100000:1.0:1788841981.017319:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841981.017439:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489140224 00000100:00100000:3.0:1788841981.017460:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489140224 00000100:00100000:3.0:1788841981.017569:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 25 00000100:00100000:3.0:1788841981.017585:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:0:x1875736489140224:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788841981.018180:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788841981.072458:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:2.0:1788841981.072475:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 090c7b3c-cdb1-4c0e-9553-671552ee3fa2 00000100:00100000:2.0:1788841981.072695:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:0:x1875736489140224:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 Request processed in 55097us (55375us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788841981.072706:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 25 00000100:00100000:3.0:1788841981.078788:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841981.078886:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489140480 00000100:00100000:2.0:1788841981.078896:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489140480 00000100:00100000:2.0:1788841981.078976:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 19 00000100:00100000:2.0:1788841981.078988:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+49:10463:x1875736489140480:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788841981.079236:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+50:10463:x1875736489140480:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 249us (458us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1788841981.079245:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 19 00000100:00100000:0.0:1788841981.081823:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841981.082787:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489140736 00000100:00100000:3.0:1788841981.082799:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489140736 00000100:00100000:0.0:1788841981.084731:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 77 00000100:00100000:0.0:1788841981.084755:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7680b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+50:10463:x1875736489140736:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788841981.084895:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7680b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+50:10463:x1875736489140736:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 149us (3081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841981.084903:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 77 00000100:00100000:0.0:1788841981.088667:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841981.088885:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489140864 00000100:00100000:3.0:1788841981.088897:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489140864 00000100:00100000:3.0:1788841981.089070:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 78 00000100:00100000:3.0:1788841981.089087:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+50:10463:x1875736489140864:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788841981.089108:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841981.089128:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b675 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2208 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.089214:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052000/0x3de1064d33a8b67c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.089230:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052000/0x3de1064d33a8b67c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.089241:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052000/0x3de1064d33a8b67c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788841981.089301:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788841981.089323:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052000/0x3de1064d33a8b67c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.089349:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8b675 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2208 expref: 52 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.089366:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052000/0x3de1064d33a8b67c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2208 expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.089386:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d3a61283200) 00010000:00010000:3.0:1788841981.089395:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788841981.089400:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60052000, rc 0) 00000100:00100000:3.0:1788841981.089469:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+51:10463:x1875736489140864:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 384us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841981.089476:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 78 00000100:00100000:3.0:1788841981.095195:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841981.095429:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489140992 00000100:00100000:0.0:1788841981.095440:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489140992 00000100:00100000:0.0:1788841981.095515:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 26 00000100:00100000:0.0:1788841981.095528:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2350:x1875736489140992:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788841981.095547:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841981.095568:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a52f08fb/0x3de1064d33a8b683 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef220f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788841981.095607:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f8ffc, blocks: 0x1 00010000:00010000:0.0:1788841981.095628:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=309s v=(0 0) 00010000:00010000:0.0:1788841981.095633:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841981.095643:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a52f08fb/0x3de1064d33a8b683 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef220f expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841981.095663:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a52f08fb/0x3de1064d33a8b683 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef220f expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841981.095677:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78e400, rc 0) 00000100:00100000:0.0:1788841981.095763:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2350:x1875736489140992:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 237us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841981.095770:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 26 00000100:00100000:0.0:1788841981.102554:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841981.102663:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489141248 00000100:00100000:2.0:1788841981.102673:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489141248 00000100:00100000:3.0:1788841981.102826:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 79 00000100:00100000:3.0:1788841981.102840:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7680bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+51:10463:x1875736489141248:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788841981.102968:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7680bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+51:10463:x1875736489141248:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 132us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841981.102977:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 79 00000100:00100000:2.0:1788841981.105794:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841981.106003:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489141376 00000100:00100000:3.0:1788841981.106013:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489141376 00000100:00100000:3.0:1788841981.106070:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 27 00000100:00100000:3.0:1788841981.106213:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:10463:x1875736489141376:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788841981.106232:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841981.106253:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a3da2f3/0x3de1064d33a8b68a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2216 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.106411:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a52f08fb/0x3de1064d33a8b683 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef220f expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.106422:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788841981.106433:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788841981.106439:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a3da2f3/0x3de1064d33a8b68a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2216 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.106541:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a52f08fb/0x3de1064d33a8b683 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef220f expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.106557:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a52f08fb/0x3de1064d33a8b683 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef220f expref: 7 pid: 6693 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841981.106583:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7687b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6696:1875736500700416:192.168.204.55@tcp:104: 00000100:00100000:2.0:1788841981.106956:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3944e293c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788841981.112261:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841981.112353:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489141504 00000100:00100000:1.0:1788841981.112363:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489141504 00010000:00010000:1.0:1788841981.112416:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a52f08fb/0x3de1064d33a8b683 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef220f expref: 8 pid: 6693 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841981.112467:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 42 00000100:00100000:1.0:1788841981.112478:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4ec1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:2350:x1875736489141504:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788841981.112494:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841981.112520:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a52f08fb/0x3de1064d33a8b683 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef220f expref: 8 pid: 6693 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.112739:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a52f08fb/0x3de1064d33a8b683 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef220f expref: 8 pid: 6693 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.112771:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788841981.112776:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788841981.112785:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006a3da2f3/0x3de1064d33a8b68a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2216 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.112796:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a3da2f3/0x3de1064d33a8b68a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2216 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.112837:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006a3da2f3/0x3de1064d33a8b68a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2216 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841981.112852:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c781180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5835:1875736500700544:192.168.204.55@tcp:105: 00000100:00100000:1.0:1788841981.113220:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611b6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788841981.118078:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a52f08fb/0x3de1064d33a8b683 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef220f expref: 8 pid: 6693 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841981.118109:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7687b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6696:1875736500700416:192.168.204.55@tcp:104: 00010000:00010000:2.0:1788841981.118146:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006a3da2f3/0x3de1064d33a8b68a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2216 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.118175:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60053800, rc 0) 00000100:00100000:2.0:1788841981.118246:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:10463:x1875736489141376:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 12039us (12459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841981.118255:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 27 00000100:00100000:1.0:1788841981.121098:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c781180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5835:1875736500700544:192.168.204.55@tcp:105: 00010000:00010000:1.0:1788841981.121126:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841981.121179:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4ec1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2350:x1875736489141504:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 8699us (8925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841981.121191:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 42 00000100:00100000:2.0:1788841981.125960:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841981.126239:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489141632 00000100:00100000:3.0:1788841981.126251:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489141632 00002000:00100000:3.0:1788841981.126315:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8d3a7c4b2a00 x1875736489141632/t0(0) o4->090c7b3c-cdb1-4c0e-9553-671552ee3fa2@192.168.204.55@tcp:107/0 lens 504/0 e 0 to 0 dl 1788841992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788841981.126327:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3a7c4b2a00 with x1875736489141632 ext(0->8) 00002000:00010000:3.0:1788841981.126334:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d3a7c4b2a00 00000100:00100000:3.0:1788841981.126358:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:3.0:1788841981.126369:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2350:x1875736489141632:12345-192.168.204.55@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788841981.132436:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:2350:x1875736489141632:12345-192.168.204.55@tcp:4:lhsmtool_posix.0 Request processed in 6059us (6481us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788841981.132460:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 0 00002000:00100000:0.0:1788841981.132473:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8d3a7c4b2a00 x1875736489141632/t4294967302(0) o4->090c7b3c-cdb1-4c0e-9553-671552ee3fa2@192.168.204.55@tcp:107/0 lens 504/448 e 0 to 0 dl 1788841992 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788841981.132493:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3a7c4b2a00 with x1875736489141632 ext(0->8) 00002000:00010000:0.0:1788841981.132499:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d3a7c4b2a00 00000100:00100000:3.0:1788841981.142252:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841981.142948:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489141760 00000100:00100000:2.0:1788841981.142959:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489141760 00000100:00100000:2.0:1788841981.143054:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 80 00000100:00100000:2.0:1788841981.143066:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7687ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+51:10463:x1875736489141760:12345-192.168.204.55@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788841981.199124:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967339 is committed 00000001:00080000:1.0:1788841981.199158:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000004:00080000:1.0:1788841981.199173:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788841981.199193:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d3a7611b900 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788841981.199199:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d3a49ae3300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d3a7611bd80 00000020:00080000:1.0:1788841981.199202:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d3a49ae3b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d3a7680fc00 00000001:00080000:1.0:1788841981.199225:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1788841981.199231:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788841981.199385:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788841981.199511:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788841981.199586:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500700672:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788841981.199656:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841981.199764:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500700800:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788841981.199794:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841981.199836:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500700672 00000100:00100000:1.0:1788841981.199844:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500700672 00000100:00100000:1.0:1788841981.199891:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500700800 00000100:00100000:1.0:1788841981.199894:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500700800 00000100:00100000:1.0:1788841981.199915:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788841981.199924:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875736500700672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788841981.199961:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1788841981.199997:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9f8ff9, atime: 0x6a9f8ff9, ctime: 0x6a9f8ff9, blocks: 0xb 00010000:00010000:1.0:1788841981.200006:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a39d7cd/0x3de1064d33a8b691 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.200023:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=309s v=(0 0) 00010000:00010000:1.0:1788841981.200027:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788841981.200033:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a39d7cd/0x3de1064d33a8b691 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.200050:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a39d7cd/0x3de1064d33a8b691 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.200060:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a39d7cd/0x3de1064d33a8b691 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.200069:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a39d7cd/0x3de1064d33a8b691 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.200084:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788841981.200598:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3310:x1875736500700672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 673us (940us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788841981.200606:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788841981.200626:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788841981.200634:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500700800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788841981.200765:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788841981.200774:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788841980 00002000:00010000:1.0:1788841981.200776:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788841981.200778:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788841980 -> 1788841980 00002000:00010000:1.0:1788841981.200781:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788841981.200814:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875736500700800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 181us (1018us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788841981.200820:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788841981.200844:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788841981.200860:0:8448:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841981.200867:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a39d7cd/0x3de1064d33a8b691 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.200877:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43530800 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788841981.200882:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a39d7cd/0x3de1064d33a8b691 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.200891:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a39d7cd/0x3de1064d33a8b691 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.200909:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a39d7cd/0x3de1064d33a8b691 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.200915:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a39d7cd/0x3de1064d33a8b691 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.200930:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841981.200932:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841981.200933:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788841981.200974:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d3a7c239500/2, rc 0, transno 4294967303 00000100:00100000:1.0:1788841981.200982:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500700800:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1788841981.201003:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d3a7c781180/2, rc 0, transno 4294967301 00000100:00100000:1.0:1788841981.201006:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500700672:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788841981.201153:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7687ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+13:10463:x1875736489141760:12345-192.168.204.55@tcp:44:lhsmtool_posix.0 Request processed in 58086us (58909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841981.201171:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 80 00000100:00100000:0.0:1788841981.205263:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841981.205302:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489141888 00000100:00100000:0.0:1788841981.205312:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489141888 00000100:00100000:0.0:1788841981.205371:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 30 00000100:00100000:0.0:1788841981.205383:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7680a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:2352:x1875736489141888:12345-192.168.204.55@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788841981.282381:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:2.0:1788841981.282405:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1788841981.282555:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7680a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2352:x1875736489141888:12345-192.168.204.55@tcp:16:lhsmtool_posix.0 Request processed in 77168us (77296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841981.282566:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 30 00000100:00100000:3.0:1788841981.287846:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841981.287945:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489142144 00000100:00100000:0.0:1788841981.287955:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489142144 00000100:00100000:3.0:1788841981.289014:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 81 00000100:00100000:3.0:1788841981.289029:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+13:10463:x1875736489142144:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788841981.289092:0:8623:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841981.289132:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052000/0x3de1064d33a8b67c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2208 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.289428:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d3a61283200) 00010000:00010000:3.0:1788841981.289434:0:8623:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788841981.289477:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b698 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.289492:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b698 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.289502:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b698 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788841981.293983:0:8623:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc2d0c80 reply state 0000000024aa1982 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b698 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841981.294001:0:8623:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788841981.295400:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+14:10463:x1875736489142144:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 6366us (7554us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788841981.295413:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 81 00010000:00010000:3.0:1788841981.299492:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b698 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.299511:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b698 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.299519:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b698 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.299525:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053e00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841981.299530:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b698 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.299554:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b698 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.299571:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d3a61283200) 00010000:00010000:3.0:1788841981.299574:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841981.299580:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b698 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.299586:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b698 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841981.301166:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841981.301291:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489142272 00000100:00100000:0.0:1788841981.301301:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489142272 00000100:00100000:0.0:1788841981.301363:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 31 00000100:00100000:0.0:1788841981.301373:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2349:x1875736489142272:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788841981.301674:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788841981.301678:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788841980 -> 1788841979 00002000:00010000:0.0:1788841981.301681:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788841977 00002000:00010000:0.0:1788841981.301682:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788841980 -> 1788841979 00002000:00010000:0.0:1788841981.301687:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788841981.301786:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2349:x1875736489142272:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 Request processed in 413us (627us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788841981.301794:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 31 00000100:00100000:0.0:1788841981.316935:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841981.317801:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489142528 00000100:00100000:1.0:1788841981.317812:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489142528 00000100:00100000:1.0:1788841981.317865:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 82 00000100:00100000:1.0:1788841981.317874:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7680a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+13:10463:x1875736489142528:12345-192.168.204.55@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788841981.317956:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b69f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.317974:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8b659 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21fa expref: 13 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.317984:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b69f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.318040:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8b659 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21fa expref: 13 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.318056:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8b659 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21fa expref: 13 pid: 6963 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841981.318072:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4486f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875736500700928:192.168.204.55@tcp:104: 00000100:00100000:1.0:1788841981.318161:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788841981.325916:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4486f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875736500700928:192.168.204.55@tcp:104: 00010000:00010000:3.0:1788841981.325949:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b69f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841981.326224:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841981.326330:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489142656 00000100:00100000:3.0:1788841981.326337:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489142656 00010000:00010000:3.0:1788841981.326374:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8b659 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21fa expref: 14 pid: 6963 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841981.326405:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 43 00000100:00100000:3.0:1788841981.326414:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76808380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+14:2349:x1875736489142656:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788841981.326429:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841981.326436:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8b659 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21fa expref: 14 pid: 6963 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.326464:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8b659 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21fa expref: 14 pid: 6963 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.326500:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8b659 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21fa expref: 14 pid: 6963 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.326516:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d3a61283200) 00010000:00010000:3.0:1788841981.326522:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b69f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.326532:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b69f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.326541:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b69f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.326574:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841981.326630:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76808380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+13:2349:x1875736489142656:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 215us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841981.326638:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 43 00010000:00010000:0.0:1788841981.327092:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b69f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841981.327101:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b69f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841981.327131:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b69f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841981.327150:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b69f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841981.327159:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b69f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841981.327165:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43531c00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841981.327170:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b69f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841981.327178:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b69f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841981.327190:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d3a61283200) 00010000:00010000:0.0:1788841981.327193:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788841981.327198:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b69f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841981.327204:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b69f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841981.327254:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7680a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+12:10463:x1875736489142528:12345-192.168.204.55@tcp:55:lhsmtool_posix.0 Request processed in 9380us (10329us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788841981.327273:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 82 00000100:00100000:1.0:1788841981.351641:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841981.351745:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489142784 00000100:00100000:3.0:1788841981.351754:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489142784 00000100:00100000:3.0:1788841981.351813:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 32 00000100:00100000:3.0:1788841981.351823:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2349:x1875736489142784:12345-192.168.204.55@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788841981.351879:0:8622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d8b5a7cb/0x3de1064d33a8b6a6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.351912:0:8622:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006a3da2f3/0x3de1064d33a8b68a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2216 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.351941:0:8622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788841981.351946:0:8622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788841981.351951:0:8622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8b5a7cb/0x3de1064d33a8b6a6 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.351989:0:8622:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006a3da2f3/0x3de1064d33a8b68a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2216 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.352004:0:8622:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006a3da2f3/0x3de1064d33a8b68a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2216 expref: 7 pid: 6696 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841981.352019:0:8622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7687aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8622:1875736500701056:192.168.204.55@tcp:104: 00000100:00100000:3.0:1788841981.352099:0:8622:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e575300 going to sleep for 11 seconds 00000100:00100000:1.0:1788841981.357382:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841981.357425:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489142912 00000100:00100000:1.0:1788841981.357434:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489142912 00010000:00010000:1.0:1788841981.357485:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006a3da2f3/0x3de1064d33a8b68a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2216 expref: 8 pid: 6696 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841981.357524:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 44 00000100:00100000:1.0:1788841981.357535:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:2350:x1875736489142912:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788841981.357550:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841981.358326:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006a3da2f3/0x3de1064d33a8b68a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2216 expref: 8 pid: 6696 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.358342:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006a3da2f3/0x3de1064d33a8b68a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2216 expref: 8 pid: 6696 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.358365:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788841981.358797:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788841981.358806:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8b5a7cb/0x3de1064d33a8b6a6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.358818:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8b5a7cb/0x3de1064d33a8b6a6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.358842:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841981.359018:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:2350:x1875736489142912:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 1482us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841981.359029:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 44 00010000:00010000:1.0:1788841981.359844:0:8622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a3da2f3/0x3de1064d33a8b68a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2216 expref: 7 pid: 6696 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841981.361679:0:8622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7687aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8622:1875736500701056:192.168.204.55@tcp:104: 00010000:00010000:1.0:1788841981.361733:0:8622:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d8b5a7cb/0x3de1064d33a8b6a6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.361746:0:8622:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d8b5a7cb/0x3de1064d33a8b6a6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.361753:0:8622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8b5a7cb/0x3de1064d33a8b6a6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.361792:0:8622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d8b5a7cb/0x3de1064d33a8b6a6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.361802:0:8622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8b5a7cb/0x3de1064d33a8b6a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.361811:0:8622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8b5a7cb/0x3de1064d33a8b6a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.361818:0:8622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053e00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788841981.361823:0:8622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8b5a7cb/0x3de1064d33a8b6a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.361832:0:8622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8b5a7cb/0x3de1064d33a8b6a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.361872:0:8622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8b5a7cb/0x3de1064d33a8b6a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841981.361880:0:8622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8b5a7cb/0x3de1064d33a8b6a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841981.362178:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2349:x1875736489142784:12345-192.168.204.55@tcp:1:lhsmtool_posix.0 Request processed in 10355us (10544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841981.362188:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 32 00000100:00100000:1.0:1788841981.384996:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841981.385076:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489143168 00000100:00100000:2.0:1788841981.385087:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489143168 00000100:00100000:2.0:1788841981.385153:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 83 00000100:00100000:2.0:1788841981.385165:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+12:10463:x1875736489143168:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788841981.385247:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b6ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.385265:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b6ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.385277:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b6ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.385540:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b6b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.385558:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b667 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2201 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.385567:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b6b4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.385601:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b667 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2201 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.385615:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b667 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2201 expref: 13 pid: 5850 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841981.385631:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c4b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875736500701184:192.168.204.55@tcp:104: 00000100:00100000:2.0:1788841981.385752:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a487eb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788841981.389776:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841981.389809:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489143296 00000100:00100000:3.0:1788841981.389818:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489143296 00010000:00010000:3.0:1788841981.389900:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b667 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2201 expref: 14 pid: 5850 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841981.389937:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 45 00000100:00100000:3.0:1788841981.389948:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76879180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+14:2350:x1875736489143296:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788841981.389962:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841981.389969:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b667 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2201 expref: 14 pid: 5850 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.389996:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b667 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2201 expref: 14 pid: 5850 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.390017:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d3a61283200) 00010000:00010000:3.0:1788841981.390022:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b6b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.390031:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b6b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.390037:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b6b4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.390054:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841981.390104:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76879180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+14:2350:x1875736489143296:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 158us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841981.390111:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 45 00010000:00010000:2.0:1788841981.396348:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b667 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2201 expref: 13 pid: 5850 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841981.396373:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c4b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875736500701184:192.168.204.55@tcp:104: 00010000:00010000:2.0:1788841981.396399:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b6b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.396606:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b6b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.396615:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b6b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788841981.396832:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1788841981.396985:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1788841981.397029:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1788841981.397127:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7687b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5851:1875736500701312:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788841981.397295:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841981.397333:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a47a3d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841981.397360:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500701312 00000100:00100000:0.0:1788841981.397367:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500701312 00000100:00100000:0.0:1788841981.397412:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788841981.397421:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5851:x1875736500701312:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788841981.397509:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5851:x1875736500701312:12345-0@lo:1000:mdt00_001.0 Request processed in 89us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841981.397517:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788841981.397761:0:5851:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788841981.397767:0:5851:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d3a7c239500, transno 4294967303 00000100:00100000:3.0:1788841981.397783:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7687b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5851:1875736500701312:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788841981.400913:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1788841981.401009:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7687b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5851:1875736500701440:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788841981.401072:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841981.401108:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a47a3d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841981.401123:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500701440 00000100:00100000:0.0:1788841981.401130:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500701440 00000100:00100000:0.0:1788841981.401175:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788841981.401195:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7687b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5851:x1875736500701440:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788841981.401426:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7687b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5851:x1875736500701440:12345-0@lo:1000:mdt00_001.0 Request processed in 232us (352us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788841981.401433:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788841981.401490:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7687b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5851:1875736500701440:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788841981.401524:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b6b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.401534:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b6b4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.401542:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b6b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.401547:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cce00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841981.401551:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b6b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.401558:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b6b4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.401573:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d3a61283200) 00010000:00010000:3.0:1788841981.401575:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788841981.401580:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b6b4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.401585:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b6b4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.401629:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b5e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.401636:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b5e2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.401642:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b5e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.401647:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841981.401650:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b5e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.401656:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b5e2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.401664:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a61283300) 00010000:00010000:3.0:1788841981.401666:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788841981.401669:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b5e2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.401675:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b5e2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.401765:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b6bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.401782:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b5fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21e5 expref: 16 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.401801:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b6bb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.401829:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b5fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21e5 expref: 16 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.401867:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b5fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21e5 expref: 16 pid: 6963 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841981.401879:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c4b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875736500701568:192.168.204.55@tcp:104: 00000100:00100000:2.0:1788841981.402048:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a487eb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841981.413921:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841981.414000:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489143424 00000100:00100000:3.0:1788841981.414011:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489143424 00010000:00010000:3.0:1788841981.414050:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b5fe lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21e5 expref: 17 pid: 6963 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841981.414092:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 46 00000100:00100000:3.0:1788841981.414103:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76808000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+17:2349:x1875736489143424:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788841981.414125:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841981.414133:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b5fe lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21e5 expref: 17 pid: 6963 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.414163:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b5fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21e5 expref: 17 pid: 6963 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.414186:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a61283300) 00010000:00010000:3.0:1788841981.414191:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b6bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.414201:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b6bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.414209:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b6bb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.414228:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841981.414288:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76808000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+17:2349:x1875736489143424:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 187us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841981.414296:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 46 00010000:00010000:2.0:1788841981.414569:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b5fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef21e5 expref: 16 pid: 6963 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841981.414584:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c4b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875736500701568:192.168.204.55@tcp:104: 00010000:00010000:2.0:1788841981.414606:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b6bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.414615:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b6bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.414621:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b6bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.414630:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b6bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.414636:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b6bb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.414649:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b6bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.414655:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788841981.414659:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b6bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.414666:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b6bb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.414676:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a61283300) 00010000:00010000:2.0:1788841981.414679:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788841981.414682:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b6bb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.414688:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b6bb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.414697:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b6ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.414702:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b6ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.414741:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b6ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.414748:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cca00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788841981.414751:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b6ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.414767:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b6ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.414777:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a61283300) 00010000:00010000:2.0:1788841981.414780:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788841981.414783:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b6ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841981.414788:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b6ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841981.415050:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+15:10463:x1875736489143168:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 29887us (30063us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1788841981.415059:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 83 00000020:00080000:2.0:1788841981.415063:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788841981.416384:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788841981.416391:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788841981.416497:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788841981.416504:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788841981.420079:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841981.420207:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489143680 00000100:00100000:0.0:1788841981.420218:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489143680 00000100:00100000:0.0:1788841981.420280:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 20 00000100:00100000:0.0:1788841981.420291:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+15:10463:x1875736489143680:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788841981.421068:0:5854:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788841981.421211:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1788841981.421263:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b6c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841981.421280:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b6c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841981.421300:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b6c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841981.421309:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b6c2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841981.421315:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b6c2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841981.421321:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b6c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841981.421340:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788841981.421433:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+17:10463:x1875736489143680:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 1143us (1358us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788841981.421455:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 20 00000020:00080000:0.0:1788841981.421461:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788841981.421497:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788841981.421503:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b6c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841981.421509:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f600 already unused, calling callback (ffffffffc1813420) 00010000:00010000:0.0:1788841981.421514:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b6c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841981.421522:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b6c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841981.421535:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:0.0:1788841981.421538:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788841981.421551:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b6c2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841981.421557:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b6c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841981.421574:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841981.421576:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841981.421578:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788841981.737109:0:11992:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788841981.737118:0:11992:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788841981.737154:0:11992:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788841981.737160:0:11992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788841981.833595:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841981.939209:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841981.939246:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489143936 00000100:00100000:3.0:1788841981.939265:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489143936 00000100:00100000:3.0:1788841981.939334:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 84 00000100:00100000:3.0:1788841981.939346:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7687bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+17:10473:x1875736489143936:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1788841981.939370:0:8623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841981.939391:0:8623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b6c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef221d expref: -99 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.939512:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052000/0x3de1064d33a8b6d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.939527:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052000/0x3de1064d33a8b6d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.939541:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052000/0x3de1064d33a8b6d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788841981.939552:0:8623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788841981.939675:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b6c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef221d expref: 20 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.939695:0:8623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052000/0x3de1064d33a8b6d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef221d expref: 19 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.939734:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:3.0:1788841981.939737:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788841981.939741:0:8623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60052000, rc 0) 00000100:00100000:3.0:1788841981.939801:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7687bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+19:10473:x1875736489143936:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 457us (600us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1788841981.939807:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 84 00000100:00100000:0.0:1788841981.947676:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841981.948574:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489144064 00000100:00100000:3.0:1788841981.948586:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489144064 00000100:00100000:3.0:1788841981.948651:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 85 00000100:00100000:3.0:1788841981.948662:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+19:10473:x1875736489144064:12345-192.168.204.55@tcp:34:lfs.0 00010000:00010000:3.0:1788841981.948822:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b6de lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.948841:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b6de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.948853:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b6de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.948871:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b6e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.948879:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.948886:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.949133:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b6ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.949142:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b6ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.949149:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b6ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788841981.949189:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b6ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.949210:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b6de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.949216:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b6de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.949223:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b6de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.949229:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841981.949234:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b6de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.949243:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b6de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.949255:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:3.0:1788841981.949258:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841981.949262:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b6de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.949268:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b6de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.950398:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.950413:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b6e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.950420:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b6e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.950445:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052a00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841981.950450:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b6e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.950458:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b6e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.950551:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3a821d0c00) 00010000:00010000:3.0:1788841981.950555:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841981.950559:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b6e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.950565:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b6e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.950586:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b6ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.950592:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b6ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.950597:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b6ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.950602:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053e00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841981.950606:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b6ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.950612:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b6ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.950632:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a821d0800) 00010000:00010000:3.0:1788841981.950634:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841981.950638:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b6ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841981.950643:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b6ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841981.951122:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+19:10473:x1875736489144064:12345-192.168.204.55@tcp:34:lfs.0 Request processed in 2454us (3450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841981.951135:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 85 00000100:00100000:3.0:1788841982.050070:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841982.050198:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489144320 00000100:00100000:2.0:1788841982.050209:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489144320 00000100:00100000:2.0:1788841982.050265:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 86 00000100:00100000:2.0:1788841982.050276:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7687a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+19:10476:x1875736489144320:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1788841982.050296:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841982.050316:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b6f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2224 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841982.050393:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b6fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841982.050409:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b6fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841982.050448:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b6fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841982.050466:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b701 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841982.050473:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b701 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841982.050480:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b701 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841982.050936:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b708 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841982.050945:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b708 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841982.050953:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b708 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841982.050963:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788841982.051120:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b6fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.051130:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b6fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.051138:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b6fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.051145:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841982.051149:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b6fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.051156:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b6fa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.051169:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:0.0:1788841982.051172:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841982.051176:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b6fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.051182:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b6fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.051205:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b701 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.051211:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b701 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.051217:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b701 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.051222:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841982.051225:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b701 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.051231:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b701 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.051239:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3a61283300) 00010000:00010000:0.0:1788841982.051242:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841982.051245:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b701 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.051251:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8b701 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.051298:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8b6f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2224 expref: 22 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.051312:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b708 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2224 expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.051329:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a61283400) 00010000:00010000:0.0:1788841982.051331:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788841982.051333:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cce00, rc 0) 00000100:00100000:0.0:1788841982.051415:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7687a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+21:10476:x1875736489144320:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 1139us (1355us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788841982.051435:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 86 00000100:00100000:3.0:1788841982.058604:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841982.058740:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489144448 00000100:00100000:0.0:1788841982.058751:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489144448 00000100:00100000:0.0:1788841982.058824:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 87 00000100:00100000:0.0:1788841982.058836:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7687a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+21:10476:x1875736489144448:12345-192.168.204.55@tcp:54:lfs.0 00010000:00010000:0.0:1788841982.058921:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b716 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.058948:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b716 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.058960:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b716 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.058987:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b716 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.058995:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b716 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.059002:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b716 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.059009:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f600 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841982.059026:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b716 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.059034:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b716 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.059047:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a61283400) 00010000:00010000:0.0:1788841982.059050:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788841982.059055:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b716 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.059062:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b716 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841982.059141:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7687a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+21:10476:x1875736489144448:12345-192.168.204.55@tcp:54:lfs.0 Request processed in 307us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841982.059148:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 87 00000100:00100000:2.0:1788841982.064389:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841982.067884:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489144704 00000100:00100000:0.0:1788841982.067905:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489144704 00000100:00100000:0.0:1788841982.068013:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00100000:0.0:1788841982.068026:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a658db050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+21:10476:x1875736489144704:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:0.0:1788841982.068318:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a658db050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+22:10476:x1875736489144704:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 294us (3938us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788841982.068327:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00100000:3.0:1788841982.161237:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841982.161341:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489144960 00000100:00100000:0.0:1788841982.161351:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489144960 00000100:00100000:0.0:1788841982.161418:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 88 00000100:00100000:0.0:1788841982.161442:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+22:10005:x1875736489144960:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:0.0:1788841982.161476:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841982.161510:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b71d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef222b expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.161616:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8b724 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.161631:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b708 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2224 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.161639:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8b724 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.161674:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b708 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2224 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.161689:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b708 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2224 expref: 23 pid: 5851 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841982.161702:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4e0b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875736500701696:192.168.204.55@tcp:104: 00000100:00100000:0.0:1788841982.161861:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a682b9180 going to sleep for 11 seconds 00000100:00100000:0.0:1788841982.166029:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4e0b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875736500701696:192.168.204.55@tcp:104: 00010000:00010000:0.0:1788841982.166060:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8b724 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841982.168809:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841982.169038:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489145088 00000100:00100000:0.0:1788841982.169048:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489145088 00010000:00010000:0.0:1788841982.169090:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b708 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2224 expref: 24 pid: 5851 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841982.169159:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 47 00000100:00100000:0.0:1788841982.169169:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76879c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+24:2349:x1875736489145088:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788841982.169185:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788841982.169192:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b708 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2224 expref: 24 pid: 5851 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.169204:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b708 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2224 expref: 24 pid: 5851 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.169244:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b708 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2224 expref: 24 pid: 5851 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.169263:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a61283400) 00010000:00010000:0.0:1788841982.169269:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8b724 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.169278:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8b724 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.169286:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8b724 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.169322:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788841982.169383:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76879c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+23:2349:x1875736489145088:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 214us (583us total) trans 0 rc 0/0 00010000:00010000:3.0:1788841982.169390:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8b724 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841982.169392:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 47 00010000:00010000:3.0:1788841982.169403:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8b724 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788841982.169433:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788841982.169599:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b71d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef222b expref: 24 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.169615:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8b724 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef222b expref: 23 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.169623:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a61283400) 00010000:00010000:3.0:1788841982.169631:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788841982.169635:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78e600, rc 0) 00000100:00100000:3.0:1788841982.169686:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+23:10005:x1875736489144960:12345-192.168.204.55@tcp:101:bash.0 Request processed in 8250us (8451us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788841982.169694:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 88 00000100:00100000:3.0:1788841982.175875:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841982.176052:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489145344 00000100:00100000:0.0:1788841982.176075:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489145344 00000100:00100000:0.0:1788841982.176137:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 89 00000100:00100000:0.0:1788841982.176148:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+23:10005:x1875736489145344:12345-192.168.204.55@tcp:36:bash.0 00010000:00010000:0.0:1788841982.176439:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8b732 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.176458:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8b732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.176479:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8b732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788841982.176534:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1788841982.176575:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b95ac083 reply state 00000000abca101e transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8b732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841982.176595:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788841982.176646:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1788841982.176795:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+27:10005:x1875736489145344:12345-192.168.204.55@tcp:36:bash.0 Request processed in 648us (931us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788841982.176803:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 89 00000020:00080000:0.0:1788841982.176808:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788841982.181859:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8b732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.181880:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8b732 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.181888:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8b732 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.181894:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f000 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841982.181899:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8b732 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.181907:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8b732 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.181925:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a61283400) 00010000:00010000:3.0:1788841982.181929:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841982.181933:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8b732 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.181939:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8b732 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841982.182486:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841982.182814:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489145472 00000100:00100000:1.0:1788841982.182826:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489145472 00000100:00100000:1.0:1788841982.182895:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 90 00000100:00100000:1.0:1788841982.182905:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+27:10005:x1875736489145472:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:1.0:1788841982.182928:0:6963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841982.182945:0:6963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b739 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2232 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.183143:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b739 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2232 expref: 28 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.183159:0:6963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b739 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2232 expref: 28 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.183267:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a61283400) 00010000:00010000:1.0:1788841982.183271:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788841982.183275:0:6963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43531e00, rc 0) 00000100:00100000:1.0:1788841982.183412:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+28:10005:x1875736489145472:12345-192.168.204.55@tcp:101:bash.0 Request processed in 507us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841982.183420:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 90 00000100:00100000:2.0:1788841982.189107:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841982.189191:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489145600 00000100:00100000:3.0:1788841982.189213:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489145600 00000100:00100000:3.0:1788841982.189273:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 33 00000100:00100000:3.0:1788841982.189284:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7d87fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:10005:x1875736489145600:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:3.0:1788841982.189311:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841982.189333:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a3da2f3/0x3de1064d33a8b740 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2239 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788841982.189359:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f8ffb, atime: 0x6a9f8ff9, ctime: 0x6a9f8ffb, blocks: 0xb 00010000:00010000:3.0:1788841982.189382:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=310s v=(0 0) 00010000:00010000:3.0:1788841982.189387:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788841982.189396:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a3da2f3/0x3de1064d33a8b740 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2239 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.189417:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006a3da2f3/0x3de1064d33a8b740 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2239 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.189441:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60053800, rc 0) 00000100:00100000:3.0:1788841982.189505:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7d87fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:10005:x1875736489145600:12345-192.168.204.55@tcp:101:bash.0 Request processed in 223us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841982.189513:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 33 00000100:00100000:0.0:1788841982.195374:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841982.196657:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489145728 00000100:00100000:3.0:1788841982.196671:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489145728 00002000:00010000:3.0:1788841982.196766:0:6699:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788841982.196772:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3a4e0b7100 with x1875736489145728 ext(0->18446744073709551615) 00002000:00010000:3.0:1788841982.196785:0:6699:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d3a4e0b7100. 00000100:00100000:3.0:1788841982.196813:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 1 00000100:00100000:3.0:1788841982.196823:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2350:x1875736489145728:12345-192.168.204.55@tcp:10:bash.0 00002000:00010000:3.0:1788841982.197385:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788841982.197390:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788841979 -> 1788841981 00002000:00010000:3.0:1788841982.197392:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788841977 -> 1788841977 00002000:00010000:3.0:1788841982.197394:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788841979 -> 1788841981 00002000:00010000:3.0:1788841982.197396:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788841982.197574:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:2350:x1875736489145728:12345-192.168.204.55@tcp:10:bash.0 Request processed in 750us (2210us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788841982.197583:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 1 00002000:00010000:3.0:1788841982.197586:0:6699:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788841982.197589:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3a4e0b7100 with x1875736489145728 ext(0->18446744073709551615) 00002000:00010000:3.0:1788841982.197593:0:6699:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d3a4e0b7100. 00000100:00100000:2.0:1788841982.333323:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841982.333432:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489145856 00000100:00100000:3.0:1788841982.333444:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489145856 00000100:00100000:3.0:1788841982.333520:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 91 00000100:00100000:3.0:1788841982.333534:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+27:10490:x1875736489145856:12345-192.168.204.55@tcp:34:lfs.0 00010000:00010000:3.0:1788841982.333612:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b747 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.333629:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b747 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.333640:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b747 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.333655:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b74e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.333663:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b74e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.333683:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b74e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.334262:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b755 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.334273:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.334282:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788841982.334322:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.334332:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b747 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.334338:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b747 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.334345:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b747 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.334350:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053e00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841982.334354:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b747 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.334361:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b747 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.334372:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:3.0:1788841982.334381:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841982.334386:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b747 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.334393:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b747 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.334410:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b74e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.334416:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b74e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.334436:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b74e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.334441:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052a00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841982.334445:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b74e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.334450:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b74e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.334457:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3a821d0300) 00010000:00010000:3.0:1788841982.334459:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841982.335251:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b74e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.335262:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b74e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.335282:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.335297:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b755 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.335303:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b755 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.335309:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841982.335312:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b755 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.335319:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b755 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.335329:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a61283400) 00010000:00010000:3.0:1788841982.335331:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841982.335334:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b755 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.335340:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b755 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841982.335443:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+27:10490:x1875736489145856:12345-192.168.204.55@tcp:34:lfs.0 Request processed in 1909us (2129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841982.335453:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 91 00000100:00100000:2.0:1788841982.410291:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841982.410444:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489146112 00000100:00100000:3.0:1788841982.410454:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489146112 00000100:00100000:3.0:1788841982.410512:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 92 00000100:00100000:3.0:1788841982.410522:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+27:10493:x1875736489146112:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1788841982.410544:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841982.410578:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b75c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2240 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.410657:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b763 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.410672:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b763 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.410682:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b763 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.410909:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b76a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.410995:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b76a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.411002:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b76a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.411417:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b771 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.411438:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b771 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.411446:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b771 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788841982.411456:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788841982.411554:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b763 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.411574:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b763 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.411586:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b763 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.411593:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052a00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841982.411597:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b763 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.411605:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b763 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.411617:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:3.0:1788841982.411620:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841982.411624:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b763 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.411629:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b763 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.411642:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b76a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.411647:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b76a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.411653:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b76a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.411657:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053e00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841982.411666:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b76a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.411672:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b76a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.411680:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3a821d0300) 00010000:00010000:3.0:1788841982.411682:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841982.411685:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b76a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.411690:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b76a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.412487:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b75c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2240 expref: 30 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.412503:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b771 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2240 expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.412510:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a61283400) 00010000:00010000:3.0:1788841982.412513:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788841982.412516:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60052400, rc 0) 00000100:00100000:3.0:1788841982.412590:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+29:10493:x1875736489146112:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 2069us (2308us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788841982.412600:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 92 00000100:00100000:0.0:1788841982.420138:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841982.420300:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489146240 00000100:00100000:1.0:1788841982.420311:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489146240 00000100:00100000:1.0:1788841982.420377:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 93 00000100:00100000:1.0:1788841982.420388:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+29:10493:x1875736489146240:12345-192.168.204.55@tcp:54:lfs.0 00010000:00010000:1.0:1788841982.420466:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b77f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.420484:0:6963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8b724 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef222b expref: 29 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.420494:0:6963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b77f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.420531:0:6963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8b724 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef222b expref: 29 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.420546:0:6963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8b724 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef222b expref: 29 pid: 5850 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841982.420560:0:6963:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4486fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6963:1875736500701824:192.168.204.55@tcp:104: 00000100:00100000:1.0:1788841982.420687:0:6963:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3944e293c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788841982.431088:0:6963:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4486fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6963:1875736500701824:192.168.204.55@tcp:104: 00010000:00010000:1.0:1788841982.431120:0:6963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b77f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841982.434242:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841982.434480:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489146496 00000100:00100000:3.0:1788841982.434493:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489146496 00000100:00100000:3.0:1788841982.434556:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 22 00000100:00100000:3.0:1788841982.434567:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+30:5590:x1875736489146496:12345-192.168.204.55@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788841982.435140:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+31:5590:x1875736489146496:12345-192.168.204.55@tcp:35:ldlm_bl.0 Request processed in 574us (907us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788841982.435149:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 22 00000100:00100000:2.0:1788841982.441436:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841982.441761:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489146624 00000100:00100000:3.0:1788841982.441771:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489146624 00010000:00010000:3.0:1788841982.441825:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8b724 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef222b expref: 31 pid: 5850 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841982.441859:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 48 00000100:00100000:3.0:1788841982.441869:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+31:2349:x1875736489146624:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788841982.441884:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841982.441891:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8b724 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef222b expref: 31 pid: 5850 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.441904:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8b724 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef222b expref: 31 pid: 5850 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.441926:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8b724 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef222b expref: 31 pid: 5850 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.441941:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a61283400) 00010000:00010000:3.0:1788841982.441947:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b77f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.441957:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b77f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.441965:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b77f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.442016:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788841982.445612:0:6963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b77f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.445631:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b77f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.445671:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b77f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.445678:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b77f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.445685:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b77f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.445692:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43531800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788841982.445696:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b77f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.445745:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b77f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.445766:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a61283400) 00010000:00010000:1.0:1788841982.445769:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788841982.445774:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b77f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.445814:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b77f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841982.446816:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+30:2349:x1875736489146624:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 4938us (5389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841982.446830:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 48 00000100:00100000:1.0:1788841982.457575:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+29:10493:x1875736489146240:12345-192.168.204.55@tcp:54:lfs.0 Request processed in 37175us (37434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841982.457590:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 93 00000100:00100000:2.0:1788841982.464647:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841982.473882:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489146880 00000100:00100000:3.0:1788841982.473903:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489146880 00000100:00100000:0.0:1788841982.474072:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 23 00000100:00100000:0.0:1788841982.474083:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+29:10493:x1875736489146880:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:0.0:1788841982.474345:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+30:10493:x1875736489146880:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 262us (9706us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788841982.474367:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 23 00000100:00100000:2.0:1788841982.675352:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841982.675494:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489147136 00000100:00100000:3.0:1788841982.675506:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489147136 00000100:00100000:3.0:1788841982.675580:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 94 00000100:00100000:3.0:1788841982.675591:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+30:10504:x1875736489147136:12345-192.168.204.55@tcp:101:cat.0 00010000:00010000:3.0:1788841982.675617:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841982.675639:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b786 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2247 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.675752:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b78d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.675767:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b78d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.675778:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b78d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.675794:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b794 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.675801:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.675808:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.676081:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8b79b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.676091:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8b79b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.676099:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8b79b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788841982.676108:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788841982.676198:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b78d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.676206:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b78d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.676212:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b78d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.676218:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053e00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841982.676223:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b78d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.676231:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b78d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.676244:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:3.0:1788841982.676247:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841982.676251:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b78d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.676267:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b78d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.676284:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.676291:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b794 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.676297:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b794 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.676302:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052a00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841982.676305:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b794 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.676311:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b794 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.676320:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3a821d0300) 00010000:00010000:3.0:1788841982.676322:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841982.676325:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b794 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.676330:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b794 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.676370:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b786 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2247 expref: 33 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.676384:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8b79b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2247 expref: 32 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.676901:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a61283400) 00010000:00010000:3.0:1788841982.676904:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788841982.676907:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40031000, rc 0) 00000100:00100000:3.0:1788841982.676978:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+32:10504:x1875736489147136:12345-192.168.204.55@tcp:101:cat.0 Request processed in 1388us (1635us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788841982.676987:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 94 00000100:00100000:0.0:1788841982.686767:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841982.687030:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489147392 00000100:00100000:2.0:1788841982.687053:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489147392 00000100:00100000:2.0:1788841982.687115:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 24 00000100:00100000:2.0:1788841982.687126:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+32:10504:x1875736489147392:12345-192.168.204.55@tcp:35:cat.0 00000100:00100000:2.0:1788841982.687471:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+33:10504:x1875736489147392:12345-192.168.204.55@tcp:35:cat.0 Request processed in 345us (712us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788841982.687479:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 24 00000100:00100000:2.0:1788841982.714828:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841982.714885:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489147648 00000100:00100000:3.0:1788841982.714896:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489147648 00000100:00100000:3.0:1788841982.714948:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 95 00000100:00100000:3.0:1788841982.714959:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+33:10505:x1875736489147648:12345-192.168.204.55@tcp:36:rm.0 00010000:00010000:3.0:1788841982.715017:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788841982.715046:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8b79b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2247 expref: 33 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.715079:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b771 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2240 expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.715093:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b739 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2232 expref: 31 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.715109:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a61283400) 00010000:00010000:3.0:1788841982.715122:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788841982.715142:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b7a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.715156:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b7a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.715178:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b7a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.715194:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b7b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.715200:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b7b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.715206:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b7b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.715471:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b7b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.715481:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b7b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.715488:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b7b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788841982.717050:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1788841982.717729:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 310875018733ns, next at 311874351600ns, rc = 0 00010000:00010000:3.0:1788841982.717818:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b7be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.717835:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b7be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.717846:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b7be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.717869:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b7be lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.717876:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b7be lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.717882:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b7be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.717911:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788841982.717934:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b7b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.717940:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b7b7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.717946:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b7b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.717951:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841982.717956:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b7b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.717964:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b7b7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.717977:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:3.0:1788841982.717980:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788841982.717985:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b7b7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.718001:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b7b7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.718022:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b7a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.718028:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b7a9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.718033:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b7a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.718037:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40030c00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841982.718040:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b7a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.718047:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b7a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.718055:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:3.0:1788841982.718057:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841982.718060:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b7a9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.718243:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841982.718251:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b7be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.718257:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052a00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788841982.718261:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b7be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.718267:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b7be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.718276:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:1.0:1788841982.718278:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788841982.718281:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b7be lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.718286:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b7be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.718301:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841982.718303:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841982.718305:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841982.718334:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8b7a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788841982.718347:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000509760e9 reply state 000000005e367089 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b7b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841982.718358:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788841982.719001:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+32:10505:x1875736489147648:12345-192.168.204.55@tcp:36:rm.0 Request processed in 4037us (4193us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788841982.719012:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 95 00010000:00010000:0.0:1788841982.724568:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b7b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.724586:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b7b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.724594:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b7b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.724601:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40031400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841982.724606:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b7b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.724614:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b7b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.724634:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3a821d0300) 00010000:00010000:0.0:1788841982.724637:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841982.724642:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b7b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.724648:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b7b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841982.787828:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841982.787937:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489147904 00000100:00100000:1.0:1788841982.787948:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489147904 00000100:00100000:1.0:1788841982.788028:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 96 00000100:00100000:1.0:1788841982.788038:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+31:10511:x1875736489147904:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:1.0:1788841982.788060:0:6963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841982.788082:0:6963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b7c5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef224e expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.788202:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b7cc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.788218:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b7cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.788228:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b7cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.788244:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b7d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.788251:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b7d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.788257:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b7d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788841982.788860:0:6963:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788841982.789034:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b7da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.789047:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b7da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.789056:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b7da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.789101:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b7cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.789108:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b7cc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.789115:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b7cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.789122:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43530800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788841982.789127:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b7cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.789135:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b7cc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.789148:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:1.0:1788841982.789152:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841982.789156:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b7cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.789162:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b7cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788841982.789181:0:6963:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6a4122d reply state 000000009de832e4 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b7d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841982.789191:0:6963:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788841982.789219:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b7c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef224e expref: 34 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.789247:0:6963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b7da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef224e expref: 33 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.789254:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a428df500) 00010000:00010000:1.0:1788841982.789257:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788841982.789259:0:6963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43531c00, rc 0) 00000100:00100000:1.0:1788841982.790352:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+34:10511:x1875736489147904:12345-192.168.204.55@tcp:101:bash.0 Request processed in 2305us (2524us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788841982.790365:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 96 00010000:00010000:3.0:1788841982.796782:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b7d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.797662:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b7d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841982.797676:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841982.797774:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489148032 00000100:00100000:1.0:1788841982.797784:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489148032 00000100:00100000:1.0:1788841982.797860:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 34 00000100:00100000:1.0:1788841982.797870:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2350:x1875736489148032:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:1.0:1788841982.797889:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841982.797908:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000101a0c0d/0x3de1064d33a8b7e8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2255 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788841982.797934:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788841982.797960:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=310s v=(0 0) 00010000:00010000:1.0:1788841982.797965:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788841982.797976:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000101a0c0d/0x3de1064d33a8b7e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2255 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.797977:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b7d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.797984:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43531e00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841982.797988:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b7d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.797995:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000101a0c0d/0x3de1064d33a8b7e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2255 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.797996:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b7d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.798012:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3a428df700) 00010000:00010000:3.0:1788841982.798015:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841982.798020:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b7d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.798025:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b7d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841982.798028:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43530400, rc 0) 00000100:00100000:1.0:1788841982.798092:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2350:x1875736489148032:12345-192.168.204.55@tcp:101:bash.0 Request processed in 223us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841982.798100:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 34 00000100:00080000:2.0:1788841982.798423:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788841982.802549:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841982.802629:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489148160 00000100:00100000:3.0:1788841982.802638:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489148160 00000100:00100000:3.0:1788841982.802704:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 35 00000100:00100000:3.0:1788841982.802757:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c238000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:10511:x1875736489148160:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:3.0:1788841982.802789:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841982.802809:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b7ef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef225c expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.802840:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000101a0c0d/0x3de1064d33a8b7e8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2255 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.802850:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788841982.802854:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788841982.802858:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b7ef lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef225c expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.802891:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000101a0c0d/0x3de1064d33a8b7e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2255 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841982.802905:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000101a0c0d/0x3de1064d33a8b7e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2255 expref: 7 pid: 6693 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841982.802920:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76878e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1875736500701952:192.168.204.55@tcp:104: 00000100:00100000:3.0:1788841982.803003:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4ead39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788841982.806083:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841982.806658:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76878e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1875736500701952:192.168.204.55@tcp:104: 00010000:00010000:2.0:1788841982.806757:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b7ef lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef225c expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841982.806779:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60052800, rc 0) 00000100:00100000:2.0:1788841982.806836:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c238000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:10511:x1875736489148160:12345-192.168.204.55@tcp:101:bash.0 Request processed in 4082us (4296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841982.806845:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 35 00000100:00100000:0.0:1788841982.807624:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489148288 00000100:00100000:0.0:1788841982.807634:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489148288 00010000:00010000:0.0:1788841982.807694:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000101a0c0d/0x3de1064d33a8b7e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2255 expref: 7 pid: 6693 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841982.807784:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 49 00000100:00100000:0.0:1788841982.807794:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4ec1b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2350:x1875736489148288:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788841982.807809:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788841982.807833:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000101a0c0d/0x3de1064d33a8b7e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2255 expref: 7 pid: 6693 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.807847:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000101a0c0d/0x3de1064d33a8b7e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2255 expref: 7 pid: 6693 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.807870:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000101a0c0d/0x3de1064d33a8b7e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2255 expref: 7 pid: 6693 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.807886:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841982.807890:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841982.807898:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b7ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef225c expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.807909:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b7ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef225c expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841982.807943:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b7ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef225c expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841982.807957:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c23b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5837:1875736500702080:192.168.204.55@tcp:105: 00000100:00100000:0.0:1788841982.808042:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a682b9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788841982.814692:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c23b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5837:1875736500702080:192.168.204.55@tcp:105: 00010000:00010000:0.0:1788841982.814746:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788841982.814798:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4ec1b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2350:x1875736489148288:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 7005us (8725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841982.814809:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 49 00000100:00100000:2.0:1788841982.821504:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841982.822069:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489148544 00000100:00100000:0.0:1788841982.822080:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489148544 00000100:00100000:0.0:1788841982.822146:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 25 00000100:00100000:0.0:1788841982.822167:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+33:10511:x1875736489148544:12345-192.168.204.55@tcp:35:bash.0 00000100:00100000:0.0:1788841982.823542:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+34:10511:x1875736489148544:12345-192.168.204.55@tcp:35:bash.0 Request processed in 1379us (2041us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788841982.823553:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 25 00010000:00010000:1.0:1788841982.849914:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841983.020233:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841983.020678:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489148672 00000100:00100000:3.0:1788841983.020688:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489148672 00000100:00100000:3.0:1788841983.020807:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 97 00000100:00100000:3.0:1788841983.020818:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+34:10527:x1875736489148672:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1788841983.020842:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841983.020878:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b7f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2263 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.020942:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b7fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.020958:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b7fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.020968:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b7fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788841983.021006:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788841983.021009:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788841983.021030:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b7fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.021054:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b7f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2263 expref: 36 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.021074:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b7fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2263 expref: 35 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.021082:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:3.0:1788841983.021085:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788841983.021089:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60053e00, rc 0) 00000100:00100000:3.0:1788841983.021159:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+35:10527:x1875736489148672:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 343us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841983.021348:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 97 00000100:00080000:2.0:1788841983.021441:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788841983.030867:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841983.030950:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489148928 00000100:00100000:3.0:1788841983.030974:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489148928 00000100:00100000:3.0:1788841983.031036:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 98 00000100:00100000:3.0:1788841983.031046:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+35:10527:x1875736489148928:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1788841983.031065:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841983.031086:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b804 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef226a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.031206:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b80b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.031219:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b80b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.031230:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b80b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788841983.031240:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788841983.031363:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b804 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef226a expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.031383:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b80b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef226a expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.031391:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a428df500) 00010000:00010000:3.0:1788841983.031394:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788841983.031397:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60052a00, rc 0) 00000100:00100000:3.0:1788841983.031473:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+37:10527:x1875736489148928:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 428us (615us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788841983.031481:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 98 00000100:00100000:1.0:1788841983.039704:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841983.039775:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841983.039901:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489149184 00000100:00100000:0.0:1788841983.039911:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489149184 00000100:00100000:0.0:1788841983.039978:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 99 00000100:00100000:0.0:1788841983.039988:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+37:10527:x1875736489149184:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1788841983.040018:0:6963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841983.040039:0:6963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8b819 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2271 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.040156:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b820 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.040172:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b820 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.040211:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b820 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788841983.040227:0:6963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788841983.040363:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8b819 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2271 expref: 40 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.040383:0:6963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b820 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2271 expref: 39 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.040392:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a428df500) 00010000:00010000:0.0:1788841983.040395:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788841983.040398:0:6963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78e800, rc 0) 00000100:00100000:0.0:1788841983.040475:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+39:10527:x1875736489149184:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 488us (790us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788841983.040482:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 99 00000100:00100000:2.0:1788841983.041054:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489149312 00000100:00100000:2.0:1788841983.041062:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489149312 00000100:00100000:2.0:1788841983.041111:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:2.0:1788841983.041120:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+39:2349:x1875736489149312:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788841983.041133:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788841983.041160:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b80b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef226a expref: 39 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841983.041183:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a428df500) 00010000:00010000:2.0:1788841983.041188:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788841983.041226:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+38:2349:x1875736489149312:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 107us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841983.041232:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:1.0:1788841983.051401:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841983.051597:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489149440 00000100:00100000:0.0:1788841983.051608:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489149440 00000100:00100000:0.0:1788841983.051690:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 36 00000100:00100000:0.0:1788841983.051702:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2349:x1875736489149440:12345-192.168.204.55@tcp:1:lfs.0 00010000:00010000:0.0:1788841983.051771:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004965dfb/0x3de1064d33a8b82e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.051793:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b7ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef225c expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.051802:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788841983.051819:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788841983.051824:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004965dfb/0x3de1064d33a8b82e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.051863:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b7ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef225c expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.051878:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b7ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef225c expref: 6 pid: 6696 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841983.051895:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c23b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1875736500702208:192.168.204.55@tcp:104: 00000100:00100000:0.0:1788841983.052006:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a682b9780 going to sleep for 11 seconds 00000100:00100000:0.0:1788841983.055986:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c23b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1875736500702208:192.168.204.55@tcp:104: 00010000:00010000:0.0:1788841983.056018:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000004965dfb/0x3de1064d33a8b82e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841983.057114:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841983.057204:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489149568 00000100:00100000:0.0:1788841983.057213:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489149568 00002000:00100000:0.0:1788841983.057272:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8d3a4486dc00 x1875736489149568/t0(0) o4->090c7b3c-cdb1-4c0e-9553-671552ee3fa2@192.168.204.55@tcp:109/0 lens 504/0 e 0 to 0 dl 1788841994 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788841983.057284:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3a4486dc00 with x1875736489149568 ext(0->8) 00010000:00010000:0.0:1788841983.057293:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b7ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef225c expref: 7 pid: 6696 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.057309:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b7ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef225c expref: 7 pid: 6696 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788841983.057339:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d3a4486dc00 00000100:00100000:0.0:1788841983.057376:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 1 00000100:00100000:0.0:1788841983.057387:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2350:x1875736489149568:12345-192.168.204.55@tcp:4:lfs.0 00000100:00100000:0.0:1788841983.057938:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:2350:x1875736489149568:12345-192.168.204.55@tcp:4:lfs.0 Request processed in 551us (829us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788841983.057947:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 1 00002000:00100000:0.0:1788841983.057955:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8d3a4486dc00 x1875736489149568/t4294967302(0) o4->090c7b3c-cdb1-4c0e-9553-671552ee3fa2@192.168.204.55@tcp:109/0 lens 504/448 e 0 to 0 dl 1788841994 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788841983.057963:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3a4486dc00 with x1875736489149568 ext(0->8) 00010000:00010000:0.0:1788841983.057970:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b7ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef225c expref: 9 pid: 6696 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.057982:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b7ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef225c expref: 9 pid: 6696 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788841983.057989:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d3a4486dc00 00000100:00100000:1.0:1788841983.062209:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841983.062323:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489149696 00000100:00100000:3.0:1788841983.062333:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489149696 00010000:00010000:3.0:1788841983.062375:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b7ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef225c expref: 9 pid: 6696 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841983.062430:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 50 00000100:00100000:3.0:1788841983.062441:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:2349:x1875736489149696:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788841983.062967:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788841983.062993:0:5836:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788841983.062996:0:5836:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788841981 00002000:00010000:3.0:1788841983.062998:0:5836:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788841982 00002000:00010000:3.0:1788841983.063000:0:5836:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788841981 00010000:00010000:3.0:1788841983.063007:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b7ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef225c expref: 9 pid: 6696 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.063021:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b7ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef225c expref: 9 pid: 6696 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.063043:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8b7ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef225c expref: 9 pid: 6696 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.063140:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788841983.063145:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788841983.063152:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004965dfb/0x3de1064d33a8b82e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.063162:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004965dfb/0x3de1064d33a8b82e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.063219:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841983.063332:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:2349:x1875736489149696:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 893us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841983.063341:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 50 00010000:00010000:0.0:1788841983.063403:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000004965dfb/0x3de1064d33a8b82e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.063423:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004965dfb/0x3de1064d33a8b82e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.063447:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004965dfb/0x3de1064d33a8b82e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.063462:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004965dfb/0x3de1064d33a8b82e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.063470:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004965dfb/0x3de1064d33a8b82e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.063477:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78e600 already unused, calling callback (ffffffffc1813420) 00010000:00010000:0.0:1788841983.063482:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004965dfb/0x3de1064d33a8b82e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.063490:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004965dfb/0x3de1064d33a8b82e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.063502:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004965dfb/0x3de1064d33a8b82e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.063509:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004965dfb/0x3de1064d33a8b82e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841983.063569:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2349:x1875736489149440:12345-192.168.204.55@tcp:1:lfs.0 Request processed in 11870us (12177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841983.063577:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 36 00000100:00100000:2.0:1788841983.068801:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841983.068897:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489149952 00000100:00100000:3.0:1788841983.068907:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489149952 00000100:00100000:3.0:1788841983.068957:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 26 00000100:00100000:3.0:1788841983.068969:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a658d9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+38:10527:x1875736489149952:12345-192.168.204.55@tcp:35:lfs.0 00000004:00010000:3.0:1788841983.069034:0:5854:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b820 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2271 expref: 38 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788841983.069351:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1788841983.069402:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1788841983.069756:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1788841983.069812:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b835 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.069828:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b7da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef224e expref: 42 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.069837:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b835 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.069870:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b7da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef224e expref: 42 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.069886:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b7da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef224e expref: 42 pid: 6963 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841983.069908:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76879880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5854:1875736500702336:192.168.204.55@tcp:104: 00000100:00100000:3.0:1788841983.069989:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788841983.076418:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76879880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5854:1875736500702336:192.168.204.55@tcp:104: 00010000:00010000:3.0:1788841983.076451:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b835 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841983.078574:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841983.078681:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489150080 00000100:00100000:0.0:1788841983.078693:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489150080 00010000:00010000:0.0:1788841983.078771:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b7da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef224e expref: 43 pid: 6963 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841983.078826:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 51 00000100:00100000:0.0:1788841983.078836:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76819c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+43:2349:x1875736489150080:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788841983.078852:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788841983.078860:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b7da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef224e expref: 43 pid: 6963 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.078873:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b7da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef224e expref: 43 pid: 6963 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.078896:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b7da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef224e expref: 43 pid: 6963 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.078920:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a428df500) 00010000:00010000:0.0:1788841983.078926:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b835 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.078936:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b835 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.078942:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b835 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.078968:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788841983.079027:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76819c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+42:2349:x1875736489150080:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 192us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841983.079034:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 51 00010000:00010000:1.0:1788841983.079235:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b835 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.079244:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b835 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788841983.079370:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1788841983.079582:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1788841983.079705:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4486d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1875736500702464:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788841983.079811:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841983.079837:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3944e29a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788841983.080289:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500702464 00000100:00100000:2.0:1788841983.080296:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500702464 00000100:00100000:2.0:1788841983.080355:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788841983.080365:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5854:x1875736500702464:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788841983.080453:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5854:x1875736500702464:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 89us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841983.080459:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788841983.081065:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788841983.081103:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4486d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1875736500702464:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788841983.081619:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1788841983.081705:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4486d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1875736500702592:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788841983.081903:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841983.081988:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3944e293c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788841983.083169:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500702592 00000100:00100000:2.0:1788841983.083180:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500702592 00000100:00100000:2.0:1788841983.083245:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788841983.083255:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5854:x1875736500702592:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788841983.083549:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5854:x1875736500702592:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 294us (1643us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788841983.083558:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788841983.084000:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4486d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1875736500702592:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788841983.084068:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1788841983.084117:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b835 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.084127:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b835 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.084136:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b835 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.084142:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788841983.084146:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b835 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.084154:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b835 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.084170:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a428df500) 00010000:00010000:1.0:1788841983.084173:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788841983.084178:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b835 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.084184:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b835 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788841983.084367:0:5854:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788841983.084516:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1788841983.084597:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 311241886380ns, next at 312241883516ns, rc = 0 00000001:00080000:1.0:1788841983.084620:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1788841983.084657:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a428df500) 00010000:00010000:1.0:1788841983.084919:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788841983.084928:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b820 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2271 expref: 46 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841983.085046:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a658d9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+45:10527:x1875736489149952:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 16078us (16254us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1788841983.085055:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 26 00000020:00080000:1.0:1788841983.085060:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788841983.089969:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841983.090210:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489150208 00000100:00100000:0.0:1788841983.090232:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489150208 00000100:00100000:0.0:1788841983.090295:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 100 00000100:00100000:0.0:1788841983.090305:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+45:10527:x1875736489150208:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1788841983.090334:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841983.090357:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8b83c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2278 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.090434:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8b83c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2278 expref: 46 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.090447:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8b83c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2278 expref: 46 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.090465:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:0.0:1788841983.090468:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788841983.090472:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78e600, rc 0) 00000100:00100000:0.0:1788841983.090619:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+46:10527:x1875736489150208:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 314us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841983.090626:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 100 00000100:00100000:2.0:1788841983.095231:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841983.095326:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489150464 00000100:00100000:0.0:1788841983.095337:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489150464 00000100:00100000:0.0:1788841983.096171:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 27 00000100:00100000:0.0:1788841983.096185:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7681b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+46:10527:x1875736489150464:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:0.0:1788841983.096479:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7681b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+47:10527:x1875736489150464:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 297us (1257us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1788841983.096487:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 27 00000100:00100000:1.0:1788841983.106134:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4486c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875736500702976:0@lo:400:kworker.0 00000100:00100000:1.0:1788841983.106206:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841983.106245:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788841983.106250:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4486ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875736500702848:0@lo:400:kworker.0 00000100:00100000:1.0:1788841983.106274:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841983.106308:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500702976 00000100:00100000:1.0:1788841983.106316:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500702976 00000100:00100000:1.0:1788841983.106367:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500702848 00000100:00100000:1.0:1788841983.106371:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500702848 00000100:00100000:1.0:1788841983.106391:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788841983.106399:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875736500702976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841983.106461:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875736500702976:12345-0@lo:400:kworker.0 Request processed in 63us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841983.106469:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788841983.106486:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788841983.106493:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875736500702848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841983.106519:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875736500702848:12345-0@lo:400:kworker.0 Request processed in 27us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841983.106551:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:1.0:1788841983.106569:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788841983.106599:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4486ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875736500702848:0@lo:400:kworker.0 00000100:00100000:1.0:1788841983.106611:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4486c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875736500702976:0@lo:400:kworker.0 00000100:00100000:2.0:1788841983.107154:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4486f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500702720:0@lo:400:kworker.0 00000100:00100000:2.0:1788841983.107201:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841983.107239:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4486d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500703232:0@lo:400:kworker.0 00000100:00100000:2.0:1788841983.107260:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841983.107285:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788841983.107290:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4486ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500703104:0@lo:400:kworker.0 00000100:00100000:2.0:1788841983.107315:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841983.107345:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500703104 00000100:00100000:2.0:1788841983.107349:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500703104 00000100:00100000:2.0:1788841983.107388:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788841983.107395:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76819180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1875736500703104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841983.107447:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76819180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1875736500703104:12345-0@lo:400:kworker.0 Request processed in 53us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841983.107454:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788841983.107472:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788841983.107492:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4486ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500703104:0@lo:400:kworker.0 00000100:00100000:0.0:1788841983.107568:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500703232 00000100:00100000:0.0:1788841983.107578:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500703232 00000100:00100000:0.0:1788841983.107616:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788841983.107622:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500703232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841983.107669:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500703232:12345-0@lo:400:kworker.0 Request processed in 36us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841983.107675:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788841983.107984:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500702720 00000100:00100000:1.0:1788841983.107989:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500702720 00000100:00100000:1.0:1788841983.108027:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788841983.108034:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3308:x1875736500702720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841983.108148:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3308:x1875736500702720:12345-0@lo:400:kworker.0 Request processed in 115us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841983.108155:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:2.0:1788841983.108256:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788841983.108277:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4486f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500702720:0@lo:400:kworker.0 00000100:00100000:2.0:1788841983.108290:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4486d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500703232:0@lo:400:kworker.0 00000100:00100000:2.0:1788841983.214810:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841983.214956:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489150592 00000100:00100000:1.0:1788841983.214966:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489150592 00000100:00100000:1.0:1788841983.215026:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 101 00000100:00100000:1.0:1788841983.215038:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+47:10537:x1875736489150592:12345-192.168.204.55@tcp:34:lfs.0 00010000:00010000:1.0:1788841983.215116:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b843 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215133:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b843 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215145:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b843 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215160:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b84a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215185:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b84a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215192:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b84a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215282:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b851 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215291:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215298:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788841983.215340:0:6963:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215355:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b843 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215361:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b843 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215368:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b843 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215374:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43530400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788841983.215379:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b843 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215386:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b843 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215416:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:1.0:1788841983.215419:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841983.215425:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b843 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215432:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b843 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215455:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b84a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215461:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b84a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215466:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b84a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215471:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43530800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788841983.215474:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b84a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215480:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b84a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215488:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3a428df500) 00010000:00010000:1.0:1788841983.215489:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841983.215492:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b84a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215496:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b84a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215521:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215528:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b851 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215534:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b851 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215541:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43531c00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788841983.215544:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b851 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215550:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b851 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215557:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:1.0:1788841983.215559:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841983.215562:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b851 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.215568:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b851 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841983.215655:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+47:10537:x1875736489150592:12345-192.168.204.55@tcp:34:lfs.0 Request processed in 617us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841983.215664:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 101 00000100:00100000:2.0:1788841983.262831:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841983.262927:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489150848 00000100:00100000:0.0:1788841983.262938:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489150848 00000100:00100000:0.0:1788841983.263002:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 102 00000100:00100000:0.0:1788841983.263013:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+47:10540:x1875736489150848:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1788841983.263034:0:8623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841983.263065:0:8623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8b858 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef227f expref: -99 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.263142:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b85f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.263158:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b85f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.263170:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b85f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.263185:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b866 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.263192:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.263197:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.263332:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b86d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.263341:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b86d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.263348:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b86d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788841983.263357:0:8623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788841983.263460:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b85f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.263469:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b85f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.263476:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b85f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.263482:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841983.263487:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b85f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.263496:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b85f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.263508:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:0.0:1788841983.263511:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841983.263515:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b85f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.263531:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b85f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.263546:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.263551:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b866 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.263556:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b866 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.263561:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f600 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841983.263564:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b866 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.263570:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b866 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.263578:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3a4e719a00) 00010000:00010000:0.0:1788841983.263580:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841983.263583:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b866 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.263588:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b866 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.263626:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8b858 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef227f expref: 50 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.263638:0:8623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b86d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef227f expref: 49 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.263651:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:0.0:1788841983.263654:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788841983.263656:0:8623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78fc00, rc 0) 00000100:00100000:0.0:1788841983.264251:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+49:10540:x1875736489150848:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 1237us (1429us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788841983.264262:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 102 00000100:00100000:2.0:1788841983.272778:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841983.272931:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489150976 00000100:00100000:3.0:1788841983.272941:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489150976 00000100:00100000:3.0:1788841983.273035:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 103 00000100:00100000:3.0:1788841983.273046:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+49:10540:x1875736489150976:12345-192.168.204.55@tcp:54:lfs.0 00010000:00010000:3.0:1788841983.273123:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b87b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.273139:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b87b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.273151:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b87b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.273175:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b87b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.273182:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b87b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.273189:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b87b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.273212:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841983.273216:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b87b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.273224:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b87b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.273237:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:3.0:1788841983.273239:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788841983.273245:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b87b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.273252:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b87b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841983.273327:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+49:10540:x1875736489150976:12345-192.168.204.55@tcp:54:lfs.0 Request processed in 282us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841983.273335:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 103 00000100:00100000:2.0:1788841983.276383:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841983.276493:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489151232 00000100:00100000:1.0:1788841983.276504:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489151232 00000100:00100000:1.0:1788841983.276594:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 28 00000100:00100000:1.0:1788841983.276616:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+49:10540:x1875736489151232:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:1.0:1788841983.277037:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+50:10540:x1875736489151232:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 420us (662us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788841983.277045:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 28 00000100:00100000:2.0:1788841983.374906:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841983.375006:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489151488 00000100:00100000:0.0:1788841983.375016:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489151488 00000100:00100000:0.0:1788841983.375090:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 104 00000100:00100000:0.0:1788841983.375101:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7617bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+50:10550:x1875736489151488:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:0.0:1788841983.375128:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841983.375131:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788841983.375162:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b7fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2263 expref: 50 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.375200:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:0.0:1788841983.375206:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788841983.375221:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8b882 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2286 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.375338:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b889 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.375354:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b86d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef227f expref: 50 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.375390:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b889 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.375439:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b86d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef227f expref: 50 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.375456:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b86d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef227f expref: 50 pid: 8623 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841983.375473:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c23b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875736500703360:192.168.204.55@tcp:104: 00000100:00100000:0.0:1788841983.376264:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a682b9180 going to sleep for 11 seconds 00000100:00100000:0.0:1788841983.392761:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841983.395568:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489151616 00000100:00100000:3.0:1788841983.395594:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489151616 00010000:00010000:3.0:1788841983.395678:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b86d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef227f expref: 51 pid: 8623 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841983.395780:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 52 00000100:00100000:3.0:1788841983.395792:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c23a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+51:2350:x1875736489151616:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788841983.395810:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841983.395817:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b86d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef227f expref: 51 pid: 8623 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.395851:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b86d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef227f expref: 51 pid: 8623 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.395883:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:3.0:1788841983.395888:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b889 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.395897:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b889 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.395904:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b889 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.395924:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841983.395984:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c23a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+51:2350:x1875736489151616:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 194us (3233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841983.395992:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 52 00010000:00010000:2.0:1788841983.400293:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8b86d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef227f expref: 50 pid: 8623 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841983.400347:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c23b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875736500703360:192.168.204.55@tcp:104: 00010000:00010000:2.0:1788841983.400373:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b889 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841983.400384:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b889 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841983.400389:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b889 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841983.400419:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788841983.400574:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8b882 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2286 expref: 51 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841983.400589:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b889 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2286 expref: 50 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841983.400598:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:2.0:1788841983.400601:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788841983.400604:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78f600, rc 0) 00000100:00100000:2.0:1788841983.400838:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7617bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+50:10550:x1875736489151488:12345-192.168.204.55@tcp:101:bash.0 Request processed in 25737us (25941us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788841983.400847:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 104 00000100:00100000:0.0:1788841983.408593:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841983.408865:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489151872 00000100:00100000:1.0:1788841983.408875:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489151872 00000100:00100000:1.0:1788841983.408938:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 105 00000100:00100000:1.0:1788841983.408949:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+50:10550:x1875736489151872:12345-192.168.204.55@tcp:36:bash.0 00010000:00010000:1.0:1788841983.409433:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b897 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.409451:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b897 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.409462:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b897 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788841983.409517:0:8623:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1788841983.409544:0:8623:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abbba24a reply state 0000000078c96bd7 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b897 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841983.409553:0:8623:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788841983.409647:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+53:10550:x1875736489151872:12345-192.168.204.55@tcp:36:bash.0 Request processed in 699us (1064us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1788841983.410271:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 105 00000020:00080000:1.0:1788841983.410278:0:8623:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788841983.413495:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b897 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.413525:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b897 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.413534:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b897 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.413540:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43530400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841983.413546:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b897 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.413553:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b897 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.413593:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:0.0:1788841983.413596:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841983.413603:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b897 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.413610:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b897 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841983.415543:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841983.415626:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489152000 00000100:00100000:3.0:1788841983.415636:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489152000 00000100:00100000:3.0:1788841983.415742:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 106 00000100:00100000:3.0:1788841983.415753:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c23b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+52:10550:x1875736489152000:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:3.0:1788841983.415776:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841983.415795:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b89e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef228d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.415897:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b8a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.415922:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b889 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2286 expref: 53 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.415931:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b8a5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.415967:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b889 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2286 expref: 53 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.415981:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b889 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2286 expref: 53 pid: 5851 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841983.415994:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76879880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875736500703488:192.168.204.55@tcp:104: 00000100:00100000:3.0:1788841983.416086:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788841983.420675:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841983.420804:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489152128 00000100:00100000:0.0:1788841983.420814:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489152128 00010000:00010000:0.0:1788841983.420856:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b889 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2286 expref: 54 pid: 5851 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841983.420901:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 53 00000100:00100000:0.0:1788841983.420912:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+54:2349:x1875736489152128:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788841983.420931:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788841983.420939:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b889 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2286 expref: 54 pid: 5851 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.420953:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b889 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2286 expref: 54 pid: 5851 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.420977:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:0.0:1788841983.420983:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b8a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.420993:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.421015:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b8a5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.421034:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788841983.421101:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+54:2349:x1875736489152128:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 190us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841983.421109:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 53 00010000:00010000:3.0:1788841983.422150:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8b889 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2286 expref: 53 pid: 5851 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841983.422182:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76879880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875736500703488:192.168.204.55@tcp:104: 00010000:00010000:3.0:1788841983.422205:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.422215:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.422220:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788841983.422269:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788841983.422286:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788841983.422309:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.422345:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b89e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef228d expref: 53 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.422359:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b8a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef228d expref: 52 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.422369:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:3.0:1788841983.422371:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788841983.422374:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60053e00, rc 0) 00000100:00100000:3.0:1788841983.422441:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c23b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+52:10550:x1875736489152000:12345-192.168.204.55@tcp:101:bash.0 Request processed in 6690us (6907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841983.422448:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 106 00000100:00100000:1.0:1788841983.428085:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841983.428175:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489152384 00000100:00100000:0.0:1788841983.428184:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489152384 00000100:00100000:0.0:1788841983.428242:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 29 00000100:00100000:0.0:1788841983.428252:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+52:10550:x1875736489152384:12345-192.168.204.55@tcp:35:bash.0 00000100:00100000:0.0:1788841983.428502:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+53:10550:x1875736489152384:12345-192.168.204.55@tcp:35:bash.0 Request processed in 250us (427us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1788841983.428510:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 29 00000040:00080000:0.0:1788841983.490049:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788841983.490061:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788841983.490097:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788841983.490103:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788841983.529651:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841983.530135:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489152512 00000100:00100000:0.0:1788841983.530146:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489152512 00000100:00100000:0.0:1788841983.530227:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 107 00000100:00100000:0.0:1788841983.530239:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+53:10556:x1875736489152512:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1788841983.530266:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841983.530480:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b8ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2294 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.530583:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8b8b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.530598:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8b8b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.530609:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8b8b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788841983.530646:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788841983.530649:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788841983.530764:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8b8b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.530791:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b8ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2294 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.530809:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8b8b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2294 expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.530817:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:0.0:1788841983.530820:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788841983.530823:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78fa00, rc 0) 00000100:00100000:0.0:1788841983.531127:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+54:10556:x1875736489152512:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 890us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841983.531134:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 107 00000100:00100000:0.0:1788841983.541371:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841983.541478:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489152640 00000100:00100000:1.0:1788841983.541610:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489152640 00000100:00100000:1.0:1788841983.541726:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 108 00000100:00100000:1.0:1788841983.541737:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+54:10556:x1875736489152640:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1788841983.541758:0:8623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841983.541777:0:8623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b8ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef229b expref: -99 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.541838:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b8c1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.541853:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b8c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.541865:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b8c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.541880:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b8c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.541886:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.541892:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.541978:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b8cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.541988:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b8cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.541994:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b8cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788841983.542032:0:8623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788841983.542037:0:8623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788841983.542066:0:8623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b8cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.542079:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b8cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.542087:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b8c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.542094:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b8c1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.542100:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b8c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.542107:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43531800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788841983.542111:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b8c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.542119:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b8c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.542131:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:1.0:1788841983.542134:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841983.542138:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b8c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.542145:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b8c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.542183:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.542189:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b8c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.542196:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b8c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.542201:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43530400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788841983.542205:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b8c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.542211:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b8c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.542219:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3a428df500) 00010000:00010000:1.0:1788841983.542222:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841983.542225:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b8c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.542230:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b8c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.542261:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8b8ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef229b expref: 56 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.542605:0:8623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b8cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef229b expref: 55 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841983.542626:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:1.0:1788841983.542629:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788841983.542632:0:8623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43530800, rc 0) 00000100:00100000:1.0:1788841983.542786:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+55:10556:x1875736489152640:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 1048us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841983.542794:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 108 00000100:00100000:3.0:1788841983.547345:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841983.547572:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489153024 00000100:00100000:2.0:1788841983.547582:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489153024 00000100:00100000:2.0:1788841983.547646:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:2.0:1788841983.547664:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76879880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+55:2349:x1875736489153024:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788841983.547692:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788841983.547736:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b8cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef229b expref: 55 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841983.547761:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:2.0:1788841983.547766:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788841983.547822:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76879880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+54:2349:x1875736489153024:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 159us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841983.547829:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:2.0:1788841983.551938:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841983.552427:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489152896 00000100:00100000:3.0:1788841983.552438:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489152896 00000100:00100000:3.0:1788841983.552507:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 109 00000100:00100000:3.0:1788841983.552518:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7617b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+54:10556:x1875736489152896:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1788841983.552538:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841983.552561:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b8d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef22a2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.553096:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b8dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.553113:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b8a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef228d expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.553134:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b8dd lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.553167:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b8a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef228d expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.553180:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b8a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef228d expref: 55 pid: 5852 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841983.553193:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76879f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875736500703616:192.168.204.55@tcp:104: 00000100:00100000:3.0:1788841983.553333:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788841983.556301:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76879f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875736500703616:192.168.204.55@tcp:104: 00010000:00010000:3.0:1788841983.556332:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b8dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841983.559149:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841983.559230:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489153152 00000100:00100000:0.0:1788841983.559252:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489153152 00010000:00010000:0.0:1788841983.559300:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b8a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef228d expref: 56 pid: 5852 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841983.559342:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 54 00000100:00100000:0.0:1788841983.559356:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4ec19850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+56:2350:x1875736489153152:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788841983.559371:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788841983.559377:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b8a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef228d expref: 56 pid: 5852 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.559390:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b8a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef228d expref: 56 pid: 5852 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.559423:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b8a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef228d expref: 56 pid: 5852 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.559444:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:0.0:1788841983.559449:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b8dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.559458:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b8dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.559465:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b8dd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.559496:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788841983.559552:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4ec19850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+55:2350:x1875736489153152:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 198us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841983.559569:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 54 00010000:00010000:3.0:1788841983.559677:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b8dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.559696:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b8dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788841983.559744:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788841983.559903:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b8d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22a2 expref: 56 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.559917:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b8dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22a2 expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.559936:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:3.0:1788841983.559939:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788841983.559941:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60052800, rc 0) 00000100:00100000:3.0:1788841983.559968:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7617b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+55:10556:x1875736489152896:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 7452us (8041us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1788841983.559975:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 109 00000100:00100000:2.0:1788841983.567085:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841983.567188:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489153408 00000100:00100000:3.0:1788841983.567198:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489153408 00000100:00100000:3.0:1788841983.567260:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:3.0:1788841983.567271:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+55:10556:x1875736489153408:12345-192.168.204.55@tcp:103:lfs.0 00010000:00010000:3.0:1788841983.567294:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841983.567318:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8b83c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2278 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841983.567337:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:3.0:1788841983.567342:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841983.567406:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+54:10556:x1875736489153408:12345-192.168.204.55@tcp:103:lfs.0 Request processed in 128us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841983.567413:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:2.0:1788841983.571021:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841983.571088:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489153536 00000100:00100000:0.0:1788841983.571098:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489153536 00000100:00100000:0.0:1788841983.571167:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 110 00000100:00100000:0.0:1788841983.571178:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+54:10556:x1875736489153536:12345-192.168.204.55@tcp:58:lfs.0 00010000:00010000:0.0:1788841983.571413:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b8eb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.571432:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b8eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.571443:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b8eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788841983.571672:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1788841983.572049:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+54:10556:x1875736489153536:12345-192.168.204.55@tcp:58:lfs.0 Request processed in 871us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841983.572058:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 110 00000100:00100000:2.0:1788841983.575881:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841983.576032:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489153664 00000100:00100000:0.0:1788841983.576043:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489153664 00000100:00100000:0.0:1788841983.576261:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 111 00000100:00100000:0.0:1788841983.576273:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+54:10556:x1875736489153664:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1788841983.576364:0:6963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841983.576384:0:6963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b8f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef22a9 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.576451:0:6963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b8eb lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.576480:0:6963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b8f2 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22a9 expref: 55 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.576499:0:6963:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b8eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.576513:0:6963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b8f2 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22a9 expref: 55 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.576639:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:0.0:1788841983.576643:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788841983.576648:0:6963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b8f2 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22a9 expref: 55 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841983.576656:0:6963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78ea00, rc 0) 00000100:00100000:0.0:1788841983.576872:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+55:10556:x1875736489153664:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 600us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841983.576879:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 111 00000100:00100000:0.0:1788841983.619756:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500703744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788841983.619843:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841983.620463:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500703744 00000100:00100000:2.0:1788841983.620473:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500703744 00000100:00100000:2.0:1788841983.620533:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788841983.620543:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3309:x1875736500703744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788841983.620567:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788841983.620625:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3309:x1875736500703744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841983.620631:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788841983.620736:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500703744:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788841983.716467:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:2.0:1788841983.716501:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:2.0:1788841983.716532:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00010000:00010000:0.0:1788841983.873985:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788841984.516655:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788841984.516664:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788841984.516752:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788841984.516759:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788841984.516907:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4926ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11681:1875736500703872:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788841984.517376:0:11681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7607bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788841984.529198:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841984.529317:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4926ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11681:1875736500703872:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788841984.530796:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489153792 00000100:00100000:3.0:1788841984.530809:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489153792 00000100:00100000:3.0:1788841984.530881:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 112 00000100:00100000:3.0:1788841984.530892:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+55:10558:x1875736489153792:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788841984.530925:0:5852:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788841984.531049:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+55:10558:x1875736489153792:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 Request processed in 158us (1862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841984.531076:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 112 00000100:00100000:3.0:1788841984.535301:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841984.536389:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489153920 00000100:00100000:0.0:1788841984.536403:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489153920 00000100:00100000:0.0:1788841984.536476:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 113 00000100:00100000:0.0:1788841984.536487:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+55:10558:x1875736489153920:12345-192.168.204.55@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788841984.536684:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b8f9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.536702:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b8f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.536747:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b8f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.536796:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b900 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.536805:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b900 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.536813:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b900 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.536839:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b907 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.536848:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b907 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.536855:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b907 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788841984.539690:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788841984.539736:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788841984.539759:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b907 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.539777:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b8f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.539785:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b8f9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.539792:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b8f9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.539798:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78ec00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841984.539802:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b8f9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.539810:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b8f9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.539826:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d3a428df000) 00010000:00010000:0.0:1788841984.539829:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841984.539833:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b8f9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.539838:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b8f9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.539860:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b900 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.539867:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b900 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.539882:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b900 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.540549:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78e400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841984.540624:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b900 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.540635:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b900 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.540648:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8d3a4e719b00) 00010000:00010000:0.0:1788841984.540650:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841984.540654:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b900 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.540661:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b900 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.540681:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b907 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.540688:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b907 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.540694:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b907 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.540699:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841984.540702:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b907 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.540771:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b907 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.540780:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:0.0:1788841984.540783:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841984.540786:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b907 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.540791:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b907 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841984.542172:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+55:10558:x1875736489153920:12345-192.168.204.55@tcp:34:lhsmtool_posix.0 Request processed in 5673us (6866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841984.542189:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 113 00000100:00100000:2.0:1788841984.550009:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841984.550110:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489154176 00000100:00100000:0.0:1788841984.550122:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489154176 00000100:00100000:0.0:1788841984.550192:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 114 00000100:00100000:0.0:1788841984.550202:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+55:10558:x1875736489154176:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788841984.550226:0:6963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841984.550257:0:6963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b90e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef22b0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.550357:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b915 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.550373:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b915 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.550396:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b915 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788841984.550419:0:6963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788841984.550522:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b915 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.550530:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b915 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.550537:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b915 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.550543:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78e400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841984.550547:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b915 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.550555:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b915 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.550569:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:0.0:1788841984.550572:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788841984.550576:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b915 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.550581:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b915 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.550623:0:6963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b90e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22b0 expref: 57 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.550635:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d3a428df000) 00010000:00010000:0.0:1788841984.550637:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788841984.550649:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b90e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22b0 expref: 57 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.550660:0:6963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78f800, rc 0) 00000100:00100000:0.0:1788841984.550768:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+56:10558:x1875736489154176:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 568us (771us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1788841984.550776:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 114 00000100:00100000:2.0:1788841984.577446:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841984.577776:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489154304 00000100:00100000:0.0:1788841984.577787:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489154304 00000100:00100000:0.0:1788841984.577837:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 115 00000100:00100000:0.0:1788841984.577846:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+56:10558:x1875736489154304:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788841984.577882:0:5850:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788841984.577992:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+56:10558:x1875736489154304:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 Request processed in 146us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841984.578000:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 115 00000100:00100000:1.0:1788841984.590962:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841984.591192:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489154560 00000100:00100000:0.0:1788841984.591204:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489154560 00000100:00100000:0.0:1788841984.591341:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 116 00000100:00100000:0.0:1788841984.591353:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+56:10558:x1875736489154560:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788841984.591387:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841984.591390:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788841984.591424:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8b8b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2294 expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.591442:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:0.0:1788841984.591447:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788841984.591460:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b923 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef22b7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788841984.592467:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1788841984.595192:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b92a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.595214:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b92a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.595225:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b92a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.595289:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b923 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22b7 expref: 58 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.595310:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b92a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22b7 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.595319:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d3a4e719b00) 00010000:00010000:0.0:1788841984.595322:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788841984.595325:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78e400, rc 0) 00000100:00100000:0.0:1788841984.595484:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+57:10558:x1875736489154560:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 4132us (4531us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788841984.595494:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 116 00000100:00100000:2.0:1788841984.614272:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841984.616660:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489154816 00000100:00100000:3.0:1788841984.616677:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489154816 00000100:00100000:3.0:1788841984.616773:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 117 00000100:00100000:3.0:1788841984.616784:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+57:10558:x1875736489154816:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788841984.616855:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841984.616885:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8b92a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22b7 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.617242:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d3a4e719b00) 00010000:00010000:3.0:1788841984.617254:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788841984.617279:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b938 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.617292:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b938 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.617301:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b938 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.617315:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b93f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x30f32a07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.617323:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b93f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x30f32a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.617330:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b93f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x30f32a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.617426:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b938 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.617433:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b938 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.617440:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b938 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.617446:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841984.617450:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b938 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.617459:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b938 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.617468:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:3.0:1788841984.617471:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841984.617474:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b938 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.617480:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8b938 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.617491:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b93f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x30f32a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.617496:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b93f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x30f32a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.617501:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b93f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x30f32a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.617516:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052a00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841984.617519:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b93f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x30f32a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.617525:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b93f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x30f32a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.617532:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x30f32a07 (ffff8d3a821d0300) 00010000:00010000:3.0:1788841984.617534:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841984.617537:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b93f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x30f32a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.617543:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8b93f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x30f32a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841984.618143:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+56:10558:x1875736489154816:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 1357us (4091us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788841984.618153:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 117 00000100:00100000:1.0:1788841984.625269:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841984.625371:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489154944 00000100:00100000:0.0:1788841984.625392:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489154944 00000100:00100000:0.0:1788841984.625453:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 118 00000100:00100000:0.0:1788841984.625464:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+56:10558:x1875736489154944:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788841984.625485:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841984.625521:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8b946 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef22be expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.625571:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b94d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.625586:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b94d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.625598:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b94d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.625704:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8b946 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22be expref: 58 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.625754:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b94d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22be expref: 57 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.625995:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d3a4e719a00) 00010000:00010000:0.0:1788841984.625999:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788841984.626003:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78ec00, rc 0) 00000100:00100000:0.0:1788841984.626478:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+57:10558:x1875736489154944:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 1014us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841984.626486:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 118 00000100:00100000:0.0:1788841984.630223:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841984.630346:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489155200 00000100:00100000:2.0:1788841984.630357:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489155200 00000100:00100000:2.0:1788841984.630436:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 119 00000100:00100000:2.0:1788841984.630448:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+57:10558:x1875736489155200:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788841984.630537:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b954 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841984.630567:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b954 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841984.630579:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b954 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788841984.631169:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1788841984.631178:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 312788468780ns, next at 313788466370ns, rc = 0 00000004:00010000:2.0:1788841984.631266:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006aec4406 reply state 00000000a32e6290 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b954 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841984.631276:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788841984.631394:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+59:10558:x1875736489155200:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 947us (1181us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788841984.631403:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 119 00010000:00010000:2.0:1788841984.640736:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b954 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841984.640787:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b954 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841984.640796:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b954 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841984.640802:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788841984.640807:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b954 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841984.640815:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b954 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841984.640833:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d3a4e719a00) 00010000:00010000:2.0:1788841984.640837:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788841984.640842:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b954 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841984.640849:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b954 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841984.649007:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841984.654847:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489155328 00000100:00100000:3.0:1788841984.654866:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489155328 00000100:00100000:3.0:1788841984.654964:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 120 00000100:00100000:3.0:1788841984.654975:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+58:10558:x1875736489155328:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788841984.655001:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841984.655024:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b95b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef22c5 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.655091:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b95b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22c5 expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.655126:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b95b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22c5 expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.655149:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d3a4e719a00) 00010000:00010000:3.0:1788841984.655153:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788841984.655156:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60053e00, rc 0) 00000100:00100000:3.0:1788841984.655230:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+59:10558:x1875736489155328:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 256us (6233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841984.655246:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 120 00000100:00100000:3.0:1788841984.658583:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841984.658755:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489155456 00000100:00100000:1.0:1788841984.658775:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489155456 00000100:00100000:1.0:1788841984.658861:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 37 00000100:00100000:1.0:1788841984.658872:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:2350:x1875736489155456:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788841984.659213:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:2350:x1875736489155456:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 Request processed in 341us (638us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788841984.659222:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 37 00000100:00080000:2.0:1788841984.659419:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788841984.672432:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841984.674390:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489155712 00000100:00100000:0.0:1788841984.674406:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489155712 00000100:00100000:0.0:1788841984.674532:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 30 00000100:00100000:0.0:1788841984.674542:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+59:10558:x1875736489155712:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788841984.674987:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+60:10558:x1875736489155712:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 445us (2565us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788841984.674997:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 30 00000100:00100000:3.0:1788841984.677390:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841984.677562:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489155968 00000100:00100000:1.0:1788841984.677572:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489155968 00000100:00100000:1.0:1788841984.677638:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 121 00000100:00100000:1.0:1788841984.677649:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+60:10558:x1875736489155968:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788841984.678337:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+60:10558:x1875736489155968:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 688us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841984.678346:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 121 00000100:00100000:3.0:1788841984.682280:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841984.682391:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489156096 00000100:00100000:2.0:1788841984.682401:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489156096 00000100:00100000:2.0:1788841984.682464:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 122 00000100:00100000:2.0:1788841984.682476:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+60:10558:x1875736489156096:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788841984.682497:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841984.682521:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8b962 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef22cc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841984.682614:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b969 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841984.682629:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b969 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841984.682640:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b969 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841984.682690:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788841984.682746:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b969 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841984.682785:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8b962 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22cc expref: 62 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841984.682801:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b969 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22cc expref: 61 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841984.682809:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d3a4e719a00) 00010000:00010000:2.0:1788841984.682811:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788841984.682815:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cd200, rc 0) 00000100:00100000:2.0:1788841984.682874:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+61:10558:x1875736489156096:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 400us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841984.682880:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 122 00000100:00100000:2.0:1788841984.688116:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841984.688203:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489156224 00000100:00100000:0.0:1788841984.688214:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489156224 00000100:00100000:0.0:1788841984.688306:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 38 00000100:00100000:0.0:1788841984.688317:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:2349:x1875736489156224:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788841984.688335:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841984.688355:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027d70e8a/0x3de1064d33a8b970 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef22d3 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788841984.688391:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f8fff, blocks: 0x1 00010000:00010000:0.0:1788841984.688408:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=312s v=(0 0) 00010000:00010000:0.0:1788841984.688412:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841984.688421:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027d70e8a/0x3de1064d33a8b970 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22d3 expref: 10 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.688439:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027d70e8a/0x3de1064d33a8b970 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22d3 expref: 10 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.688452:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78fa00, rc 0) 00000100:00100000:0.0:1788841984.688507:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+10:2349:x1875736489156224:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 192us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841984.688514:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 38 00000100:00100000:0.0:1788841984.695792:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841984.695933:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489156480 00000100:00100000:2.0:1788841984.695945:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489156480 00000100:00100000:2.0:1788841984.696014:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 123 00000100:00100000:2.0:1788841984.696025:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+61:10558:x1875736489156480:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788841984.696144:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+61:10558:x1875736489156480:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 120us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841984.696152:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 123 00000100:00100000:3.0:1788841984.704904:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841984.719347:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489156608 00000100:00100000:1.0:1788841984.719364:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489156608 00000100:00100000:1.0:1788841984.719509:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 39 00000100:00100000:1.0:1788841984.719521:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+10:10558:x1875736489156608:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788841984.719540:0:8622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841984.719561:0:8622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5d6e0f4/0x3de1064d33a8b977 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef22da expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.719596:0:8622:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027d70e8a/0x3de1064d33a8b970 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22d3 expref: 11 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.719606:0:8622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788841984.719611:0:8622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788841984.719617:0:8622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d6e0f4/0x3de1064d33a8b977 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22da expref: 11 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.719655:0:8622:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000027d70e8a/0x3de1064d33a8b970 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22d3 expref: 11 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.719671:0:8622:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000027d70e8a/0x3de1064d33a8b970 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22d3 expref: 11 pid: 6695 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841984.719700:0:8622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4486c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8622:1875736500704000:192.168.204.55@tcp:104: 00000100:00100000:1.0:1788841984.719852:0:8622:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a429d8480 going to sleep for 11 seconds 00000100:00100000:3.0:1788841984.723469:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841984.723893:0:8622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4486c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8622:1875736500704000:192.168.204.55@tcp:104: 00010000:00010000:1.0:1788841984.723932:0:8622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f5d6e0f4/0x3de1064d33a8b977 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22da expref: 11 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.723974:0:8622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43531800, rc 0) 00000100:00100000:1.0:1788841984.724041:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+11:10558:x1875736489156608:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 4521us (19160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841984.724051:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 39 00000100:00100000:0.0:1788841984.724997:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489156736 00000100:00100000:0.0:1788841984.725008:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489156736 00010000:00010000:0.0:1788841984.725053:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000027d70e8a/0x3de1064d33a8b970 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22d3 expref: 11 pid: 6695 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841984.725094:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 55 00000100:00100000:0.0:1788841984.725103:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76878a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+11:2350:x1875736489156736:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788841984.725127:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788841984.725153:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000027d70e8a/0x3de1064d33a8b970 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22d3 expref: 11 pid: 6695 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.725166:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000027d70e8a/0x3de1064d33a8b970 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22d3 expref: 11 pid: 6695 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.725188:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027d70e8a/0x3de1064d33a8b970 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22d3 expref: 11 pid: 6695 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.725204:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841984.725218:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841984.725226:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5d6e0f4/0x3de1064d33a8b977 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22da expref: 10 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.725241:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d6e0f4/0x3de1064d33a8b977 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22da expref: 10 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.725274:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f5d6e0f4/0x3de1064d33a8b977 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22da expref: 10 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841984.725295:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c23a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5835:1875736500704128:192.168.204.55@tcp:105: 00000100:00100000:0.0:1788841984.725368:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7607b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788841984.733169:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c23a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5835:1875736500704128:192.168.204.55@tcp:105: 00010000:00010000:0.0:1788841984.733199:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788841984.733273:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76878a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+10:2350:x1875736489156736:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 8171us (9814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841984.733286:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 55 00000100:00100000:3.0:1788841984.744472:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841984.744639:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489156864 00000100:00100000:0.0:1788841984.744661:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489156864 00002000:00100000:0.0:1788841984.744916:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8d3a7687aa00 x1875736489156864/t0(0) o4->090c7b3c-cdb1-4c0e-9553-671552ee3fa2@192.168.204.55@tcp:110/0 lens 504/0 e 0 to 0 dl 1788841995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788841984.744931:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3a7687aa00 with x1875736489156864 ext(0->12) 00002000:00010000:0.0:1788841984.744937:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d3a7687aa00 00000100:00100000:0.0:1788841984.744981:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 2 00000100:00100000:0.0:1788841984.744992:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7687aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+10:2349:x1875736489156864:12345-192.168.204.55@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788841984.745605:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7687aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+12:2349:x1875736489156864:12345-192.168.204.55@tcp:4:lhsmtool_posix.0 Request processed in 612us (1140us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788841984.745614:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 2 00002000:00100000:0.0:1788841984.745623:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8d3a7687aa00 x1875736489156864/t4294967308(0) o4->090c7b3c-cdb1-4c0e-9553-671552ee3fa2@192.168.204.55@tcp:110/0 lens 504/448 e 0 to 0 dl 1788841995 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788841984.745631:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3a7687aa00 with x1875736489156864 ext(0->12) 00002000:00010000:0.0:1788841984.745635:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d3a7687aa00 00000100:00100000:3.0:1788841984.750123:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841984.750869:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489156992 00000100:00100000:0.0:1788841984.750880:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489156992 00000100:00100000:0.0:1788841984.750955:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 124 00000100:00100000:0.0:1788841984.750967:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7687b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+61:10558:x1875736489156992:12345-192.168.204.55@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788841984.838889:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1788841984.839464:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1788841984.839489:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d3944e29d80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1788841984.839494:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d3a49ae3400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d3a47a3dd80 00000020:00080000:2.0:1788841984.839497:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d3a49ae3100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d3945763000 00000020:00080000:2.0:1788841984.839518:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:2.0:1788841984.839525:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1788841984.839550:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788841984.839564:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d3a47a3d9c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788841984.839566:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d3a490ab500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d3a47a3d3c0 00000020:00080000:2.0:1788841984.839569:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d3a4eac2700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d3a58194800 00000100:00100000:3.0:1788841984.839763:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788841984.839782:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500704256:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788841984.839852:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841984.839929:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500704256 00000100:00100000:3.0:1788841984.839937:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500704256 00000100:00100000:3.0:1788841984.839986:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788841984.839995:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500704256:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788841984.840020:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1788841984.840068:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f8ffd, atime: 0x6a9f8ffe, ctime: 0x6a9f8ffd, blocks: 0xb 00010000:00010000:3.0:1788841984.840091:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024581163/0x3de1064d33a8b97e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.840111:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=312s v=(0 0) 00010000:00010000:3.0:1788841984.840115:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788841984.840122:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024581163/0x3de1064d33a8b97e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.840138:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024581163/0x3de1064d33a8b97e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.840148:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024581163/0x3de1064d33a8b97e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.840155:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024581163/0x3de1064d33a8b97e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.840173:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788841984.840776:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875736500704256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 779us (921us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788841984.840785:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1788841984.840818:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788841984.840825:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024581163/0x3de1064d33a8b97e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.840835:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052a00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:3.0:1788841984.840839:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024581163/0x3de1064d33a8b97e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.840856:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024581163/0x3de1064d33a8b97e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.840873:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024581163/0x3de1064d33a8b97e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.840881:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024581163/0x3de1064d33a8b97e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.840899:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841984.840901:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841984.840902:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841984.840929:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788841984.840934:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:3.0:1788841984.840951:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d3a7c781180, transno 4294967301 00000004:00080000:3.0:1788841984.840962:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:3.0:1788841984.840977:0:3309:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8d3a7616c700 x1875736500704256/t4294967304(4294967304) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788842000 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788841984.840988:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d3a7616c700/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788841984.840994:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500704256:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1788841984.841754:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1788841984.841900:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788841984.842265:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c23a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500704384:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788841984.842322:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841984.842382:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788841984.842389:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500704512:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788841984.842411:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841984.842464:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500704384 00000100:00100000:3.0:1788841984.842472:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500704384 00000100:00100000:3.0:1788841984.842510:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500704512 00000100:00100000:3.0:1788841984.842513:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500704512 00000100:00100000:3.0:1788841984.842531:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788841984.842539:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1875736500704384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788841984.842564:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:3.0:1788841984.842589:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000322789a0/0x3de1064d33a8b985 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.842611:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006a3da2f3/0x3de1064d33a8b740 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2239 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.842620:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788841984.842625:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788841984.842629:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000322789a0/0x3de1064d33a8b985 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.842669:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006a3da2f3/0x3de1064d33a8b740 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2239 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.842683:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006a3da2f3/0x3de1064d33a8b740 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2239 expref: 11 pid: 6696 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841984.842696:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76808380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1875736500704640:192.168.204.55@tcp:104: 00000100:00100000:3.0:1788841984.842771:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4ead3180 going to sleep for 11 seconds 00000100:00100000:3.0:1788841984.842788:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788841984.842802:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1875736500704512:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788841984.842941:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788841984.842945:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788841983 00002000:00010000:3.0:1788841984.842948:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788841984.842950:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788841983 -> 1788841983 00002000:00010000:3.0:1788841984.842952:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788841984.842991:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3307:x1875736500704512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 190us (578us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788841984.842998:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:3.0:1788841984.843593:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d3a7c238e00/2, rc 0, transno 4294967309 00000100:00100000:3.0:1788841984.843602:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500704512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788841984.845534:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7687b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+15:10558:x1875736489156992:12345-192.168.204.55@tcp:44:lhsmtool_posix.0 Request processed in 94563us (95425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841984.845546:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 124 00000100:00100000:0.0:1788841984.847879:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76808380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1875736500704640:192.168.204.55@tcp:104: 00010000:00010000:0.0:1788841984.847921:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000322789a0/0x3de1064d33a8b985 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841984.855947:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841984.856000:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841984.856062:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489157248 00000100:00100000:3.0:1788841984.856074:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489157248 00000100:00100000:3.0:1788841984.856137:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 43 00000100:00100000:3.0:1788841984.856147:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7680a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+12:2351:x1875736489157248:12345-192.168.204.55@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788841984.856663:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489157120 00000100:00100000:1.0:1788841984.856670:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489157120 00010000:00010000:1.0:1788841984.856700:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006a3da2f3/0x3de1064d33a8b740 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2239 expref: 13 pid: 6696 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841984.856763:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 56 00000100:00100000:1.0:1788841984.856772:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76808000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+13:2350:x1875736489157120:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788841984.856784:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841984.856790:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 000000006a3da2f3/0x3de1064d33a8b740 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2239 expref: 13 pid: 6696 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.856805:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006a3da2f3/0x3de1064d33a8b740 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2239 expref: 13 pid: 6696 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.856830:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a3da2f3/0x3de1064d33a8b740 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2239 expref: 13 pid: 6696 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.856872:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1788841984.856877:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788841984.857154:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000322789a0/0x3de1064d33a8b985 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.857167:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000322789a0/0x3de1064d33a8b985 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.857206:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841984.857264:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76808000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+12:2350:x1875736489157120:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 493us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841984.857272:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 56 00010000:00010000:0.0:1788841984.858459:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000322789a0/0x3de1064d33a8b985 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.858477:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000322789a0/0x3de1064d33a8b985 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.858488:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000322789a0/0x3de1064d33a8b985 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.858497:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000322789a0/0x3de1064d33a8b985 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.858526:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788841984.859389:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3307:x1875736500704384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16836us (17052us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788841984.859400:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:3.0:1788841984.859686:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d3a7c23a300/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788841984.859695:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c23a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500704384:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788841984.860175:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841984.860187:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000322789a0/0x3de1064d33a8b985 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.860199:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052400 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788841984.860204:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000322789a0/0x3de1064d33a8b985 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.860214:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000322789a0/0x3de1064d33a8b985 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.860235:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000322789a0/0x3de1064d33a8b985 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.860255:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000322789a0/0x3de1064d33a8b985 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.860280:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841984.860283:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841984.860285:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841984.897819:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788841984.932036:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1788841984.932053:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1788841984.932222:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7680a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2351:x1875736489157248:12345-192.168.204.55@tcp:16:lhsmtool_posix.0 Request processed in 76069us (76214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841984.932234:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 43 00000100:00100000:0.0:1788841984.941647:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841984.943061:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489157504 00000100:00100000:3.0:1788841984.943075:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489157504 00000100:00100000:3.0:1788841984.943160:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 125 00000100:00100000:3.0:1788841984.943170:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+15:10558:x1875736489157504:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788841984.943234:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841984.943262:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8b969 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22cc expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.943297:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d3a4e719a00) 00010000:00010000:3.0:1788841984.943302:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788841984.943333:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b98c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.943346:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b98c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.943355:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b98c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788841984.943618:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008bb859f6 reply state 000000003d0d0ef0 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b98c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841984.943628:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788841984.943797:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+16:10558:x1875736489157504:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 627us (2159us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1788841984.943804:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 125 00010000:00010000:0.0:1788841984.947120:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b98c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.947140:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b98c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.947148:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b98c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.947153:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40031400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841984.947158:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b98c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.947166:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b98c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.947183:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d3a4e719a00) 00010000:00010000:0.0:1788841984.947186:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841984.947191:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b98c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.947197:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8b98c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841984.948502:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841984.948587:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489157632 00000100:00100000:1.0:1788841984.948597:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489157632 00000100:00100000:1.0:1788841984.948661:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 44 00000100:00100000:1.0:1788841984.948671:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2349:x1875736489157632:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788841984.948944:0:8622:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788841984.948947:0:8622:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788841983 -> 1788841982 00002000:00010000:1.0:1788841984.948950:0:8622:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788841982 00002000:00010000:1.0:1788841984.948952:0:8622:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788841983 -> 1788841982 00002000:00010000:1.0:1788841984.948954:0:8622:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788841984.949009:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2349:x1875736489157632:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 Request processed in 339us (516us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788841984.949016:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 44 00000100:00100000:3.0:1788841984.958612:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841984.958703:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489157888 00000100:00100000:0.0:1788841984.958745:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489157888 00000100:00100000:0.0:1788841984.958809:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 126 00000100:00100000:0.0:1788841984.958820:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+15:10558:x1875736489157888:12345-192.168.204.55@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788841984.958921:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b993 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.958937:0:6963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b94d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22be expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.958947:0:6963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b993 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.958980:0:6963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b94d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22be expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.958993:0:6963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b94d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22be expref: 15 pid: 5850 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841984.959006:0:6963:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76210380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6963:1875736500704768:192.168.204.55@tcp:104: 00000100:00100000:0.0:1788841984.959112:0:6963:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a76036000 going to sleep for 11 seconds 00000100:00100000:0.0:1788841984.962331:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841984.962416:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489158016 00000100:00100000:3.0:1788841984.962426:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489158016 00010000:00010000:3.0:1788841984.962469:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b94d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22be expref: 16 pid: 5850 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841984.962546:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 57 00000100:00100000:3.0:1788841984.962558:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76212300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+16:2350:x1875736489158016:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788841984.962573:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841984.962580:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b94d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22be expref: 16 pid: 5850 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.962607:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b94d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22be expref: 16 pid: 5850 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.962628:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d3a4e719a00) 00010000:00010000:3.0:1788841984.962633:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b993 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.962642:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.962663:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b993 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.962681:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841984.962763:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76212300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+16:2350:x1875736489158016:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 208us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841984.962770:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 57 00010000:00010000:1.0:1788841984.964188:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8b94d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22be expref: 15 pid: 5850 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841984.964213:0:6963:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76210380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6963:1875736500704768:192.168.204.55@tcp:104: 00010000:00010000:1.0:1788841984.964238:0:6963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.964343:0:6963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.964351:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.964399:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.964407:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b993 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.964425:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b993 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.964432:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841984.964436:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b993 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.964443:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b993 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.964458:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d3a4e719a00) 00010000:00010000:0.0:1788841984.964461:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788841984.964465:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b993 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.964470:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8b993 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841984.964583:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+14:10558:x1875736489157888:12345-192.168.204.55@tcp:55:lhsmtool_posix.0 Request processed in 5764us (5982us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788841984.964593:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 126 00000100:00100000:0.0:1788841984.969565:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841984.970321:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489158144 00000100:00100000:3.0:1788841984.970333:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489158144 00000100:00100000:3.0:1788841984.970407:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 45 00000100:00100000:3.0:1788841984.970416:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2349:x1875736489158144:12345-192.168.204.55@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788841984.970462:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002e5cb22b/0x3de1064d33a8b99a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.970485:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5d6e0f4/0x3de1064d33a8b977 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22da expref: 7 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.970515:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788841984.970520:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788841984.970586:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e5cb22b/0x3de1064d33a8b99a lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.970726:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f5d6e0f4/0x3de1064d33a8b977 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22da expref: 7 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841984.970744:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f5d6e0f4/0x3de1064d33a8b977 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22da expref: 7 pid: 8622 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841984.970759:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75cd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1875736500704896:192.168.204.55@tcp:104: 00000100:00100000:3.0:1788841984.970866:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4ead3180 going to sleep for 11 seconds 00000100:00100000:0.0:1788841984.977542:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75cd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1875736500704896:192.168.204.55@tcp:104: 00010000:00010000:0.0:1788841984.977574:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002e5cb22b/0x3de1064d33a8b99a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841984.979226:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841984.979315:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489158272 00000100:00100000:1.0:1788841984.979324:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489158272 00010000:00010000:1.0:1788841984.979366:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d6e0f4/0x3de1064d33a8b977 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22da expref: 8 pid: 8622 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841984.979418:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 58 00000100:00100000:1.0:1788841984.979429:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76210700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:2350:x1875736489158272:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788841984.979446:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841984.979470:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f5d6e0f4/0x3de1064d33a8b977 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22da expref: 8 pid: 8622 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.979483:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f5d6e0f4/0x3de1064d33a8b977 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22da expref: 8 pid: 8622 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.979507:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5d6e0f4/0x3de1064d33a8b977 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22da expref: 8 pid: 8622 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.979523:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788841984.979528:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788841984.979533:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002e5cb22b/0x3de1064d33a8b99a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.979543:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e5cb22b/0x3de1064d33a8b99a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.979595:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841984.979653:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76210700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2350:x1875736489158272:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 225us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841984.979660:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 58 00010000:00010000:0.0:1788841984.979868:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002e5cb22b/0x3de1064d33a8b99a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.979896:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e5cb22b/0x3de1064d33a8b99a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.979924:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002e5cb22b/0x3de1064d33a8b99a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.979934:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e5cb22b/0x3de1064d33a8b99a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.979942:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e5cb22b/0x3de1064d33a8b99a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.979950:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40030c00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:0.0:1788841984.979955:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e5cb22b/0x3de1064d33a8b99a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.979963:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e5cb22b/0x3de1064d33a8b99a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.979976:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e5cb22b/0x3de1064d33a8b99a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841984.979984:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e5cb22b/0x3de1064d33a8b99a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841984.980049:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2349:x1875736489158144:12345-192.168.204.55@tcp:1:lhsmtool_posix.0 Request processed in 9633us (10493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841984.980057:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 45 00000100:00100000:0.0:1788841984.987410:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841984.987503:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489158528 00000100:00100000:1.0:1788841984.987514:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489158528 00000100:00100000:1.0:1788841984.987575:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 127 00000100:00100000:1.0:1788841984.987586:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+14:10558:x1875736489158528:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788841984.987680:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b9a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.987699:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b9a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.987744:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b9a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.987963:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b9a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.987975:0:8623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b95b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22c5 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.987983:0:8623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b9a8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.988017:0:8623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b95b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22c5 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.988178:0:8623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b95b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22c5 expref: 15 pid: 5852 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841984.988193:0:8623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4486c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8623:1875736500705024:192.168.204.55@tcp:104: 00000100:00100000:1.0:1788841984.988285:0:8623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d39456a46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788841984.991135:0:8623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4486c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8623:1875736500705024:192.168.204.55@tcp:104: 00010000:00010000:1.0:1788841984.991166:0:8623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b9a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841984.997000:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841984.998328:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489158656 00000100:00100000:2.0:1788841984.998344:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489158656 00010000:00010000:2.0:1788841984.998407:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b95b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22c5 expref: 16 pid: 5852 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841984.998498:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 59 00000100:00100000:2.0:1788841984.998509:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+16:2349:x1875736489158656:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788841984.998537:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788841984.998545:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b95b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22c5 expref: 16 pid: 5852 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841984.998559:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b95b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22c5 expref: 16 pid: 5852 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841984.998582:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8b95b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22c5 expref: 16 pid: 5852 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841984.998605:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d3a4e719a00) 00010000:00010000:2.0:1788841984.998612:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b9a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841984.998621:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b9a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841984.998629:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b9a8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841984.998676:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788841984.998771:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+15:2349:x1875736489158656:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 263us (1779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841984.998780:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 59 00010000:00010000:1.0:1788841984.998850:0:8623:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b9a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841984.998859:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b9a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788841984.999102:0:8623:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1788841984.999268:0:8623:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1788841984.999316:0:8623:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1788841984.999408:0:8623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4486c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8623:1875736500705152:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788841984.999466:0:8623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841984.999495:0:8623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d39456a4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788841984.999521:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500705152 00000100:00100000:1.0:1788841984.999525:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500705152 00000100:00100000:1.0:1788841984.999555:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788841984.999562:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8623:x1875736500705152:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788841984.999629:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8623:x1875736500705152:12345-0@lo:1000:mdt00_004.0 Request processed in 67us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841984.999648:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788841984.999682:0:8623:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788841984.999688:0:8623:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:1.0:1788841984.999703:0:8623:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d3a7c238e00, transno 4294967309 00000004:00080000:1.0:1788841984.999737:0:8623:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d3a7c23a300, transno 4294967310 00000100:00100000:1.0:1788841984.999744:0:8623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4486c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8623:1875736500705152:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1788841985.000147:0:8623:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1788841985.000197:0:8623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4486c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8623:1875736500705280:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788841985.000229:0:8623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841985.000248:0:8623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a429d8480 going to sleep for 11 seconds 00000100:00100000:1.0:1788841985.000561:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500705280 00000100:00100000:1.0:1788841985.000567:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500705280 00000100:00080000:2.0:1788841985.000597:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788841985.000606:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788841985.000614:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8623:x1875736500705280:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788841985.000814:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8623:x1875736500705280:12345-0@lo:1000:mdt00_004.0 Request processed in 200us (583us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788841985.000822:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788841985.000914:0:8623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4486c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8623:1875736500705280:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1788841985.000951:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b9a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841985.000971:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b9a8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841985.000978:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b9a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841985.000984:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43531c00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788841985.000988:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b9a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841985.000996:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b9a8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841985.001010:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d3a4e719a00) 00010000:00010000:2.0:1788841985.001013:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788841985.001017:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b9a8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841985.001024:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8b9a8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841985.001078:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b8eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841985.001088:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b8eb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841985.001093:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b8eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841985.001097:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788841985.001107:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b8eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841985.001115:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b8eb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841985.001125:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:2.0:1788841985.001127:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788841985.001134:0:8623:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b8f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22a9 expref: 18 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841985.001145:0:8623:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b8f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22a9 expref: 18 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841985.001154:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b8f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22a9 expref: 18 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841985.001183:0:8623:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b8f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22a9 expref: 18 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841985.001194:0:8623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c780000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8623:1875736500705408:192.168.204.55@tcp:105: 00000100:00100000:2.0:1788841985.001252:0:8623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788841985.006106:0:8623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c780000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8623:1875736500705408:192.168.204.55@tcp:105: 00000100:00100000:2.0:1788841985.006272:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00010000:00010000:1.0:1788841985.006332:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b8eb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841985.006337:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489158784 00010000:00010000:1.0:1788841985.006342:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8b8eb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841985.006344:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489158784 00010000:00010000:1.0:1788841985.006388:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b9af lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.006416:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b9af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841985.006423:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 31 00010000:00010000:1.0:1788841985.006427:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b9af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841985.006433:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+19:10556:x1875736489158784:12345-192.168.204.55@tcp:49:lfs.0 00010000:00010000:1.0:1788841985.006437:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b9af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.006442:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b9af lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.006448:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b9af lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.006453:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43530400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788841985.006457:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b9af lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.006463:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b9af lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.006473:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:1.0:1788841985.006475:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841985.006479:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b9af lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.006484:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8b9af lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.006503:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b9a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.006513:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b9a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.006518:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b9a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.006523:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43531800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788841985.006526:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b9a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.006531:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b9a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.006539:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:1.0:1788841985.006542:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1788841985.006545:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+19:10556:x1875736489158784:12345-192.168.204.55@tcp:49:lfs.0 Request processed in 114us (276us total) trans 0 rc 0/0 00010000:00010000:1.0:1788841985.006545:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b9a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.006551:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8b9a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841985.006553:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 31 00000100:00100000:1.0:1788841985.006796:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+18:10558:x1875736489158528:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 19211us (19396us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1788841985.006804:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 127 00000020:00080000:1.0:1788841985.006807:0:8623:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00080000:2.0:1788841985.006944:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788841985.007219:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788841985.007224:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788841985.007843:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788841985.007853:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788841985.009450:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841985.009567:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489159040 00000100:00100000:3.0:1788841985.009577:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489159040 00000100:00100000:3.0:1788841985.009636:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 128 00000100:00100000:3.0:1788841985.009647:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+18:10556:x1875736489159040:12345-192.168.204.55@tcp:58:lfs.0 00000100:00100000:0.0:1788841985.010012:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000040:00080000:3.0:1788841985.010097:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788841985.010430:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+18:10556:x1875736489159040:12345-192.168.204.55@tcp:58:lfs.0 Request processed in 784us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841985.010438:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 128 00000100:00100000:1.0:1788841985.010490:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489159296 00000100:00100000:1.0:1788841985.010496:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489159296 00000100:00100000:1.0:1788841985.010570:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 32 00000100:00100000:1.0:1788841985.010579:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a658dac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+18:10558:x1875736489159296:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788841985.011334:0:5854:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788841985.011472:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1788841985.011520:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b9b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.011594:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b9b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.011606:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b9b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.011615:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b9b6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.011620:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b9b6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.011625:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b9b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.011650:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788841985.011759:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a658dac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+20:10558:x1875736489159296:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 1179us (1744us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788841985.011768:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 32 00000020:00080000:1.0:1788841985.011772:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788841985.011898:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788841985.011906:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b9b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841985.011913:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43530800 already unused, calling callback (ffffffffc1813420) 00010000:00010000:0.0:1788841985.011917:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b9b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841985.011924:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b9b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841985.011938:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d3a428df500) 00010000:00010000:0.0:1788841985.011941:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788841985.011945:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b9b6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841985.011951:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8b9b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841985.011971:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841985.011973:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841985.011974:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841985.059842:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841985.063434:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489159424 00000100:00100000:2.0:1788841985.063451:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489159424 00000100:00100000:2.0:1788841985.063549:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 129 00000100:00100000:2.0:1788841985.063560:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+20:10560:x1875736489159424:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1788841985.063600:0:6963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841985.063624:0:6963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b9bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef22e1 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841985.063690:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b9c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841985.063704:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b9c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841985.063769:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b9c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841985.063784:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b9cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841985.063791:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b9cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841985.063798:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b9cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841985.064032:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b9d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841985.064045:0:6963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b8dd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22a2 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841985.064053:0:6963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b9d2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841985.064088:0:6963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b8dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22a2 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841985.064308:0:6963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b8dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22a2 expref: 21 pid: 5852 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841985.064324:0:6963:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c782a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6963:1875736500705536:192.168.204.55@tcp:104: 00000100:00100000:3.0:1788841985.064506:0:6963:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788841985.067123:0:6963:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c782a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6963:1875736500705536:192.168.204.55@tcp:104: 00010000:00010000:0.0:1788841985.067157:0:6963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b9d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841985.067547:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841985.067706:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489159680 00000100:00100000:2.0:1788841985.067757:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489159680 00000100:00100000:2.0:1788841985.068289:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 33 00000100:00100000:2.0:1788841985.068302:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+22:5590:x1875736489159680:12345-192.168.204.55@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788841985.068573:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+23:5590:x1875736489159680:12345-192.168.204.55@tcp:35:ldlm_bl.0 Request processed in 273us (1027us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788841985.068581:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 33 00000100:00100000:3.0:1788841985.080563:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841985.080673:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489159808 00000100:00100000:1.0:1788841985.080683:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489159808 00010000:00010000:1.0:1788841985.080822:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b8dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22a2 expref: 23 pid: 5852 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841985.081048:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 60 00000100:00100000:0.0:1788841985.081061:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4ec1b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+23:2351:x1875736489159808:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788841985.081078:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788841985.081086:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b8dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22a2 expref: 23 pid: 5852 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841985.081098:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b8dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22a2 expref: 23 pid: 5852 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841985.081130:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8b8dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22a2 expref: 23 pid: 5852 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841985.081145:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:0.0:1788841985.081150:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b9d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841985.081158:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841985.081166:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b9d2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841985.081210:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788841985.081270:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4ec1b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+22:2351:x1875736489159808:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 211us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841985.081290:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 60 00010000:00010000:1.0:1788841985.081386:0:6963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.081402:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788841985.081448:0:6963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788841985.081453:0:6963:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788841985.081473:0:6963:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.081485:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.081495:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b9c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.081501:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b9c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.081507:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b9c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.081512:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cda00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788841985.081516:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b9c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.081523:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b9c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.081532:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:1.0:1788841985.081535:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841985.081539:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b9c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.081555:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b9c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.081567:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b9cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.081574:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b9cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.081579:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b9cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.081584:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cc000 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788841985.081588:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b9cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.081593:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b9cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.081600:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3a61283a00) 00010000:00010000:1.0:1788841985.081602:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841985.081605:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b9cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.081610:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8b9cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.081642:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8b9bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22e1 expref: 22 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.081656:0:6963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b9d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22e1 expref: 21 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841985.081668:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:1.0:1788841985.081670:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788841985.081672:0:6963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cd400, rc 0) 00000100:00100000:1.0:1788841985.081699:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+21:10560:x1875736489159424:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 18141us (21868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841985.081706:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 129 00000100:00100000:0.0:1788841985.665940:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500705664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788841985.666018:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841985.668276:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500705664 00000100:00100000:2.0:1788841985.668289:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500705664 00000100:00100000:2.0:1788841985.668352:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788841985.668375:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875736500705664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788841985.668405:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1788841985.668483:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875736500705664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (2464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841985.668492:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788841985.668621:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500705664:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788841985.914559:0:12046:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788841985.914569:0:12046:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788841985.914614:0:12046:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788841985.914620:0:12046:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788841985.925168:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841985.957929:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841985.957968:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841985.957997:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841985.958015:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841985.958031:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841985.958059:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489159936 00000100:00100000:3.0:1788841985.958069:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489159936 00000100:00100000:1.0:1788841985.958076:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489160320 00000100:00100000:1.0:1788841985.958080:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489160320 00000100:00100000:1.0:1788841985.958121:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489160192 00000100:00100000:1.0:1788841985.958124:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489160192 00000100:00100000:3.0:1788841985.958136:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 291 00000100:00100000:1.0:1788841985.958144:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 78 00000100:00100000:3.0:1788841985.958148:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2350:x1875736489159936:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788841985.958150:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2350:x1875736489160320:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788841985.958420:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489160064 00000100:00100000:2.0:1788841985.958425:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489160064 00000100:00100000:2.0:1788841985.958454:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489160448 00000100:00100000:2.0:1788841985.958457:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489160448 00000100:00100000:2.0:1788841985.958478:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 143 00000100:00100000:2.0:1788841985.958485:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+21:2350:x1875736489160064:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788841985.958563:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2350:x1875736489160320:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 411us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841985.958571:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 78 00000100:00100000:1.0:1788841985.958590:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 79 00000100:00100000:1.0:1788841985.958597:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2350:x1875736489160192:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841985.962446:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2350:x1875736489159936:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 4287us (4434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841985.962463:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 291 00000100:00100000:3.0:1788841985.962535:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 144 00000100:00100000:3.0:1788841985.962550:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489160448:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841985.962601:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489160448:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 57us (4568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841985.962621:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 144 00000100:00100000:2.0:1788841985.965723:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+21:2350:x1875736489160064:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 7209us (7772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841985.965739:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 143 00000100:00100000:1.0:1788841985.969327:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2350:x1875736489160192:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 10715us (11296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841985.969342:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 79 00000100:00080000:1.0:1788841985.969407:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788841985.969413:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1788841986.049942:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788841986.049952:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788841986.050017:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788841986.050025:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788841986.050331:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75cd6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11681:1875736500705792:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788841986.050563:0:11681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a500c0240 going to sleep for 11 seconds 00000100:00100000:2.0:1788841986.063909:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841986.064274:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75cd6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11681:1875736500705792:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788841986.067675:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489160576 00000100:00100000:0.0:1788841986.067690:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489160576 00000100:00100000:0.0:1788841986.067812:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 130 00000100:00100000:0.0:1788841986.067822:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+21:10572:x1875736489160576:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788841986.067854:0:6963:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788841986.068076:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+21:10572:x1875736489160576:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 Request processed in 254us (4176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841986.068084:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 130 00000100:00100000:3.0:1788841986.079857:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841986.083540:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489160832 00000100:00100000:0.0:1788841986.083553:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489160832 00000100:00100000:0.0:1788841986.083617:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 131 00000100:00100000:0.0:1788841986.083629:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+21:10572:x1875736489160832:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788841986.083653:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841986.083685:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b9d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef22e8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841986.083816:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8b9e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841986.083832:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8b9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841986.083862:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8b9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788841986.083875:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788841986.084018:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8b9d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22e8 expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841986.084036:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8b9e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22e8 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841986.084045:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:0.0:1788841986.084049:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788841986.084052:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78e200, rc 0) 00000100:00100000:0.0:1788841986.084121:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+23:10572:x1875736489160832:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 495us (4273us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1788841986.084129:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 131 00000100:00100000:2.0:1788841986.099728:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841986.099779:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841986.099807:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489161216 00000100:00100000:2.0:1788841986.099817:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489161216 00000100:00100000:2.0:1788841986.099881:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:2.0:1788841986.099891:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c781180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+23:2349:x1875736489161216:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788841986.099909:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788841986.099935:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8b9e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22e8 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841986.099953:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:2.0:1788841986.099958:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788841986.100026:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c781180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+22:2349:x1875736489161216:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 137us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841986.100043:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:3.0:1788841986.101888:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489161088 00000100:00100000:3.0:1788841986.101905:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489161088 00000100:00100000:3.0:1788841986.101988:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 132 00000100:00100000:3.0:1788841986.102113:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+22:10572:x1875736489161088:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788841986.102211:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8b9ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841986.102229:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8b9ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841986.102240:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8b9ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841986.102456:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8b9ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841986.102463:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8b9ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841986.102485:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8b9ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841986.102490:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40031000 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788841986.102494:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8b9ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841986.102501:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8b9ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841986.102513:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:3.0:1788841986.102516:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788841986.102532:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8b9ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841986.102539:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8b9ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841986.103818:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+23:10572:x1875736489161088:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 1814us (4108us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788841986.103829:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 132 00000040:00080000:2.0:1788841986.104405:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788841986.104412:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788841986.104962:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788841986.104974:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788841986.115414:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841986.115486:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489161472 00000100:00100000:3.0:1788841986.115496:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489161472 00000100:00100000:3.0:1788841986.115552:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 34 00000100:00100000:3.0:1788841986.115562:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+23:10572:x1875736489161472:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788841986.115978:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+24:10572:x1875736489161472:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 416us (570us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788841986.115986:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 34 00010000:00010000:1.0:1788841986.945909:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841987.969850:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788841988.072551:0:12097:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788841988.072674:0:12097:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788841988.073027:0:12097:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788841988.073035:0:12097:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788841988.235508:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500706304:0@lo:400:kworker.0 00000100:00100000:2.0:1788841988.235595:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841988.235663:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788841988.235670:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b77a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500705920:0@lo:400:kworker.0 00000100:00100000:2.0:1788841988.235705:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841988.235766:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875736500706432:0@lo:400:kworker.0 00000100:00100000:2.0:1788841988.235794:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841988.235822:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b77b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875736500706176:0@lo:400:kworker.0 00000100:00100000:2.0:1788841988.235852:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841988.235873:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788841988.235879:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b77aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875736500706048:0@lo:400:kworker.0 00000100:00100000:2.0:1788841988.235902:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841988.235919:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500706560:0@lo:400:kworker.0 00000100:00100000:2.0:1788841988.235939:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841988.235986:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500706432 00000100:00100000:2.0:1788841988.235993:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500706432 00000100:00100000:2.0:1788841988.236047:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500706176 00000100:00100000:2.0:1788841988.236050:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500706176 00000100:00100000:2.0:1788841988.236068:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500706048 00000100:00100000:2.0:1788841988.236071:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500706048 00000100:00100000:2.0:1788841988.236090:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788841988.236099:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875736500706432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841988.236155:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875736500706432:12345-0@lo:400:kworker.0 Request processed in 56us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841988.236164:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788841988.236190:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788841988.236196:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875736500706176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841988.236235:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875736500706176:12345-0@lo:400:kworker.0 Request processed in 39us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841988.236241:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788841988.236254:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788841988.236261:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7668b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875736500706048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841988.236291:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7668b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875736500706048:12345-0@lo:400:kworker.0 Request processed in 31us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841988.236296:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788841988.236331:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500706304 00000100:00100000:2.0:1788841988.236335:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500706304 00000100:00100000:2.0:1788841988.236361:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500706560 00000100:00100000:2.0:1788841988.236364:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500706560 00000100:00100000:2.0:1788841988.236384:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788841988.236390:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76689880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1875736500706304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841988.236428:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76689880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1875736500706304:12345-0@lo:400:kworker.0 Request processed in 38us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841988.236436:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788841988.236447:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788841988.236452:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7668ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1875736500706560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841988.236478:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7668ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1875736500706560:12345-0@lo:400:kworker.0 Request processed in 26us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841988.236483:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1788841988.236497:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788841988.236501:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788841988.236503:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788841988.236541:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b77aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875736500706048:0@lo:400:kworker.0 00000100:00100000:2.0:1788841988.236552:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500706560:0@lo:400:kworker.0 00000100:00100000:2.0:1788841988.236561:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b77b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875736500706176:0@lo:400:kworker.0 00000100:00100000:2.0:1788841988.236608:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875736500706432:0@lo:400:kworker.0 00000100:00100000:2.0:1788841988.236617:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500706304:0@lo:400:kworker.0 00000100:00100000:3.0:1788841988.238049:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500705920 00000100:00100000:3.0:1788841988.238060:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500705920 00000100:00100000:3.0:1788841988.238147:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788841988.238156:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3309:x1875736500705920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841988.238235:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3309:x1875736500705920:12345-0@lo:400:kworker.0 Request processed in 81us (2530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841988.238243:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788841988.238333:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b77a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500705920:0@lo:400:kworker.0 00000100:00100000:3.0:1788841988.385412:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841988.385565:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489161728 00000100:00100000:2.0:1788841988.385576:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489161728 00000100:00100000:2.0:1788841988.385653:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 133 00000100:00100000:2.0:1788841988.385664:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+24:10592:x1875736489161728:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1788841988.385693:0:6963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841988.385734:0:6963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8b9f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef22ef expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841988.385852:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b9fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841988.385868:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b9fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841988.385881:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b9fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841988.385893:0:6963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788841988.386028:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8b9f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22ef expref: 27 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841988.386055:0:6963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b9fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22ef expref: 26 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841988.386088:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:2.0:1788841988.386092:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788841988.386095:0:6963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cda00, rc 0) 00000100:00080000:1.0:1788841988.386233:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788841988.389264:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+26:10592:x1875736489161728:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 3589us (3850us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788841988.389280:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 133 00000100:00100000:2.0:1788841988.394536:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841988.396278:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489161856 00000100:00100000:0.0:1788841988.396293:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489161856 00000100:00100000:1.0:1788841988.396426:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 134 00000100:00100000:1.0:1788841988.396438:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+26:10592:x1875736489161856:12345-192.168.204.55@tcp:54:lfs.0 00010000:00010000:1.0:1788841988.396505:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8ba0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841988.396523:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8ba0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841988.396534:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8ba0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841988.396562:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8ba0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841988.396569:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8ba0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841988.396576:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8ba0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841988.396582:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43531c00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788841988.396587:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8ba0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841988.396594:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8ba0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841988.396622:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:1.0:1788841988.396625:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788841988.396630:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8ba0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841988.396636:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531c00/0x3de1064d33a8ba0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841988.396750:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+26:10592:x1875736489161856:12345-192.168.204.55@tcp:54:lfs.0 Request processed in 314us (2225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841988.396758:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 134 00000100:00100000:2.0:1788841988.567734:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841988.567888:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489161984 00000100:00100000:1.0:1788841988.567900:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489161984 00000100:00100000:1.0:1788841988.567994:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 46 00000100:00100000:1.0:1788841988.568004:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2349:x1875736489161984:12345-192.168.204.55@tcp:101:cat.0 00010000:00010000:1.0:1788841988.568023:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841988.568060:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfa3eb35/0x3de1064d33a8ba11 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef22f6 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788841988.568102:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f8ffe, atime: 0x6a9f8ffe, ctime: 0x6a9f8ffe, blocks: 0xb 00010000:00010000:1.0:1788841988.568123:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=316s v=(0 0) 00010000:00010000:1.0:1788841988.568128:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788841988.568139:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfa3eb35/0x3de1064d33a8ba11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22f6 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841988.568159:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bfa3eb35/0x3de1064d33a8ba11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22f6 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841988.568193:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43531c00, rc 0) 00000100:00100000:1.0:1788841988.568262:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2349:x1875736489161984:12345-192.168.204.55@tcp:101:cat.0 Request processed in 259us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841988.568270:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 46 00000100:00080000:2.0:1788841988.568683:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788841988.577648:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841988.577927:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489162112 00000100:00100000:0.0:1788841988.577940:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489162112 00002000:00100000:0.0:1788841988.578011:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8d3a75cd5c00 x1875736489162112/t0(0) o3->090c7b3c-cdb1-4c0e-9553-671552ee3fa2@192.168.204.55@tcp:114/0 lens 488/0 e 0 to 0 dl 1788841999 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788841988.578023:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3a75cd5c00 with x1875736489162112 ext(0->4095) 00002000:00010000:0.0:1788841988.578029:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d3a75cd5c00 00000100:00100000:0.0:1788841988.578061:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 3 00000100:00100000:0.0:1788841988.578071:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2351:x1875736489162112:12345-192.168.204.55@tcp:3:cat.0 00000100:00100000:0.0:1788841988.578341:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2351:x1875736489162112:12345-192.168.204.55@tcp:3:cat.0 Request processed in 269us (707us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788841988.578350:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 3 00002000:00100000:0.0:1788841988.578357:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8d3a75cd5c00 x1875736489162112/t0(0) o3->090c7b3c-cdb1-4c0e-9553-671552ee3fa2@192.168.204.55@tcp:114/0 lens 488/4536 e 0 to 0 dl 1788841999 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788841988.578365:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3a75cd5c00 with x1875736489162112 ext(0->4095) 00002000:00010000:0.0:1788841988.578368:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d3a75cd5c00 00000100:00100000:1.0:1788841988.740983:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788841988.741007:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4486ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500706688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788841988.741082:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841988.741161:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500706688 00000100:00100000:1.0:1788841988.741168:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500706688 00000100:00100000:1.0:1788841988.741216:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788841988.741228:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875736500706688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788841988.741259:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788841988.741318:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875736500706688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841988.741325:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788841988.741370:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4486ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500706688:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788841988.794281:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:0.0:1788841988.993937:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788841989.839200:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000020:00080000:2.0:1788841989.839217:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788841989.839242:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d3a429d8d80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788841989.839248:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d3a49ae3600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d3a429d8840 00000020:00080000:2.0:1788841989.839252:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d3a49ae3200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d3a49a97400 00000001:00080000:2.0:1788841989.839269:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1788841989.839308:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788841989.839500:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1788841990.018847:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788841990.307656:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:2.0:1788841990.307668:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:1.0:1788841990.794071:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500706816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788841990.794144:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841990.794244:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500706816 00000100:00100000:0.0:1788841990.794252:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500706816 00000100:00100000:0.0:1788841990.794328:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788841990.794339:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500706816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788841990.794373:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788841990.796704:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788841990.801799:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500706816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7451us (7643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841990.801815:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788841990.809063:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1788841990.809075:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1788841990.809109:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500706816:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788841991.041985:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841991.096684:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841991.096887:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841991.096928:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841991.096976:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841991.097019:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489162624 00000100:00100000:2.0:1788841991.097053:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489162624 00000100:00100000:2.0:1788841991.097125:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489162496 00000100:00100000:2.0:1788841991.097128:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489162496 00000100:00100000:2.0:1788841991.097170:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 82 00000100:00100000:2.0:1788841991.097184:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7668aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2351:x1875736489162624:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788841991.097316:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7668aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2351:x1875736489162624:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 135us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841991.097324:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 82 00000100:00100000:2.0:1788841991.097345:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 83 00000100:00100000:2.0:1788841991.097352:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2351:x1875736489162496:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788841991.097382:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2351:x1875736489162496:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 32us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841991.097388:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 83 00000100:00080000:2.0:1788841991.097406:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788841991.097411:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788841991.097729:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489162240 00000100:00100000:3.0:1788841991.097736:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489162240 00000100:00100000:3.0:1788841991.097775:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 293 00000100:00100000:3.0:1788841991.097784:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2352:x1875736489162240:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841991.097824:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2352:x1875736489162240:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 42us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841991.097830:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 293 00000100:00100000:3.0:1788841991.097865:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489162368 00000100:00100000:3.0:1788841991.097870:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489162368 00000100:00100000:3.0:1788841991.097906:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 148 00000100:00100000:3.0:1788841991.097914:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+13:2351:x1875736489162368:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841991.097949:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+13:2351:x1875736489162368:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 36us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841991.097956:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 148 00000100:00080000:3.0:1788841991.097988:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788841991.098071:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841991.098098:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489162752 00000100:00100000:3.0:1788841991.098113:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489162752 00000100:00100000:3.0:1788841991.098162:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 149 00000100:00100000:3.0:1788841991.098169:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2351:x1875736489162752:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841991.098205:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2351:x1875736489162752:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 36us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841991.098225:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 149 00000100:00080000:2.0:1788841991.100807:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788841992.066039:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841993.092226:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788841993.282171:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788841993.282185:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788841993.282610:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1788841993.282619:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788841993.354031:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4486d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875736500707200:0@lo:400:kworker.0 00000100:00100000:1.0:1788841993.354056:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7681b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500707328:0@lo:400:kworker.0 00000100:00100000:1.0:1788841993.354140:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841993.354244:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4486c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500706944:0@lo:400:kworker.0 00000100:00100000:1.0:1788841993.354264:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4486ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500707072:0@lo:400:kworker.0 00000100:00100000:3.0:1788841993.354315:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841993.354326:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841993.354375:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875736500707456:0@lo:400:kworker.0 00000100:00100000:1.0:1788841993.354378:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500707584:0@lo:400:kworker.0 00000100:00100000:3.0:1788841993.354421:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841993.354430:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841993.354482:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500706944 00000100:00100000:3.0:1788841993.354493:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500706944 00000100:00100000:3.0:1788841993.354556:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788841993.354565:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a43e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3310:x1875736500706944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841993.354627:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a43e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3310:x1875736500706944:12345-0@lo:400:kworker.0 Request processed in 63us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841993.354634:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788841993.354670:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500707072 00000100:00100000:3.0:1788841993.354673:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500707072 00000100:00100000:3.0:1788841993.354696:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500707456 00000100:00100000:3.0:1788841993.354698:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500707456 00000100:00100000:3.0:1788841993.354763:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788841993.354772:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c23a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500707072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841993.354792:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788841993.354811:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875736500707456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841993.354821:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c23a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500707072:12345-0@lo:400:kworker.0 Request processed in 49us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841993.354830:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788841993.354879:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500707328 00000100:00100000:3.0:1788841993.354884:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500707328 00000100:00100000:1.0:1788841993.354892:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875736500707456:12345-0@lo:400:kworker.0 Request processed in 85us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841993.354903:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788841993.354920:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500707584 00000100:00100000:3.0:1788841993.354925:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500707584 00000100:00100000:3.0:1788841993.354957:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788841993.354969:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500707328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841993.354976:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788841993.354992:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500707584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841993.355030:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500707328:12345-0@lo:400:kworker.0 Request processed in 64us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841993.355039:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788841993.355054:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500707584:12345-0@lo:400:kworker.0 Request processed in 63us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841993.355067:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788841993.355341:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841993.355405:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500707200 00000100:00080000:2.0:1788841993.355413:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788841993.355416:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500707200 00000100:00080000:2.0:1788841993.355421:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788841993.355427:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788841993.355452:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4486c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500706944:0@lo:400:kworker.0 00000100:00100000:1.0:1788841993.355476:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788841993.355481:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875736500707456:0@lo:400:kworker.0 00000100:00100000:3.0:1788841993.356822:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4486ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500707072:0@lo:400:kworker.0 00000100:00100000:3.0:1788841993.356839:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788841993.356845:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d3a7616c700, transno 4294967304 00000100:00100000:3.0:1788841993.356861:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500707584:0@lo:400:kworker.0 00000100:00100000:3.0:1788841993.356893:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7681b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500707328:0@lo:400:kworker.0 00000100:00100000:1.0:1788841993.360154:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7668b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875736500707200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841993.360418:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7668b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875736500707200:12345-0@lo:400:kworker.0 Request processed in 4927us (5076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841993.360430:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788841993.362479:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4486d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875736500707200:0@lo:400:kworker.0 00000100:00100000:2.0:1788841993.487602:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841993.487681:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489162880 00000100:00100000:1.0:1788841993.487695:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489162880 00000100:00100000:1.0:1788841993.487843:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 135 00000100:00100000:1.0:1788841993.487885:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+13:10245:x1875736489162880:12345-192.168.204.55@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788841993.488035:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+13:10245:x1875736489162880:12345-192.168.204.55@tcp:60:lhsmtool_posix.0 Request processed in 153us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841993.488043:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 135 00000100:00080000:2.0:1788841993.488333:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788841993.491610:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841993.492090:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489163136 00000100:00100000:1.0:1788841993.492106:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489163136 00000100:00100000:1.0:1788841993.492191:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 35 00000100:00100000:1.0:1788841993.492203:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+13:10245:x1875736489163136:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788841993.493414:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+14:10245:x1875736489163136:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 1205us (1811us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788841993.493428:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 35 00000100:00100000:0.0:1788841993.699808:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841993.699903:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489163264 00000100:00100000:3.0:1788841993.699918:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489163264 00000100:00100000:3.0:1788841993.700098:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 136 00000100:00100000:3.0:1788841993.700112:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:11044:x1875736489163264:12345-192.168.204.55@tcp:101:lsof.0 00010000:00010000:3.0:1788841993.700140:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841993.700168:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8ba18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef22fd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841993.700296:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8ba1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841993.700313:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8ba1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841993.700338:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8ba1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788841993.700400:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788841993.700405:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788841993.700463:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8ba1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841993.700877:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8ba18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22fd expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841993.700904:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8ba1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22fd expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841993.700914:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a4e719900) 00010000:00010000:3.0:1788841993.700917:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788841993.700922:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40030c00, rc 0) 00000100:00100000:3.0:1788841993.701101:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:419331f1-87f8-40c5-a1c8-5f66078f5ec5+6:11044:x1875736489163264:12345-192.168.204.55@tcp:101:lsof.0 Request processed in 990us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841993.701111:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 136 00000100:00080000:2.0:1788841993.702636:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788841993.864486:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788841993.864518:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7668b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500707712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788841993.864615:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841993.864918:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500707712 00000100:00100000:2.0:1788841993.864945:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500707712 00000100:00100000:2.0:1788841993.865028:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788841993.865040:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7687b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500707712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788841993.865085:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788841993.865157:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7687b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500707712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841993.865166:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788841993.865245:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7668b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500707712:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788841994.114039:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788841994.911434:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1788841994.911450:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788841994.911486:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788841994.911500:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1788841995.138903:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841995.906826:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788841995.906860:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7668b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500707840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788841995.906983:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841995.908061:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500707840 00000100:00100000:0.0:1788841995.908075:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500707840 00000100:00100000:0.0:1788841995.908190:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788841995.908203:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500707840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788841995.908275:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788841995.908365:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500707840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841995.908373:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788841995.908629:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7668b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500707840:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788841995.908641:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788841996.163488:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841996.200530:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841996.200590:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841996.200749:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841996.200776:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788841996.200860:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489163520 00000100:00100000:1.0:1788841996.200873:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489163520 00000100:00100000:1.0:1788841996.200966:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 153 00000100:00100000:1.0:1788841996.200980:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+13:2352:x1875736489163520:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788841996.201109:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+13:2352:x1875736489163520:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 132us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841996.201118:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 153 00000100:00080000:1.0:1788841996.201149:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788841996.201329:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489163392 00000100:00100000:1.0:1788841996.201334:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489163392 00000100:00100000:1.0:1788841996.201367:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 295 00000100:00100000:1.0:1788841996.201374:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2352:x1875736489163392:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788841996.201409:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2352:x1875736489163392:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 35us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841996.201416:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 295 00000100:00100000:0.0:1788841996.208384:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489163776 00000100:00100000:0.0:1788841996.208408:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489163776 00000100:00100000:0.0:1788841996.208530:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489163648 00000100:00100000:0.0:1788841996.208535:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489163648 00000100:00100000:0.0:1788841996.208585:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 86 00000100:00100000:0.0:1788841996.208600:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2352:x1875736489163776:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788841996.208742:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2352:x1875736489163776:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 145us (8150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841996.208751:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 86 00000100:00100000:0.0:1788841996.208773:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 87 00000100:00100000:0.0:1788841996.208780:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2352:x1875736489163648:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788841996.208808:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2352:x1875736489163648:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 29us (8031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841996.208815:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 87 00000100:00080000:1.0:1788841996.211554:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788841996.211570:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788841996.212393:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788841996.212569:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489163904 00000100:00100000:3.0:1788841996.212583:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489163904 00000100:00080000:1.0:1788841996.212676:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788841996.212911:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 154 00000100:00100000:3.0:1788841996.212925:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419331f1-87f8-40c5-a1c8-5f66078f5ec5+6:2352:x1875736489163904:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788841996.213032:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419331f1-87f8-40c5-a1c8-5f66078f5ec5+6:2352:x1875736489163904:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 110us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841996.213041:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 154 00000001:02000400:3.0:1788841997.054337:0:12300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 00:33:14 (1788841994) 00010000:00010000:0.0:1788841997.198240:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841998.209947:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841998.468447:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7668bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500708096:0@lo:400:kworker.0 00000100:00100000:0.0:1788841998.468524:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841998.468602:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500708608:0@lo:400:kworker.0 00000100:00100000:0.0:1788841998.468628:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841998.468664:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788841998.468670:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7668a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500708224:0@lo:400:kworker.0 00000100:00100000:0.0:1788841998.468739:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841998.468776:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500708608 00000100:00100000:0.0:1788841998.468785:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500708608 00000100:00100000:0.0:1788841998.468844:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788841998.468853:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500708608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841998.468907:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500708608:12345-0@lo:400:kworker.0 Request processed in 55us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841998.468915:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788841998.469056:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500708096 00000100:00100000:0.0:1788841998.469060:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500708096 00000100:00100000:0.0:1788841998.469086:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500708224 00000100:00100000:0.0:1788841998.469089:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500708224 00000100:00100000:0.0:1788841998.469124:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788841998.469131:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500708096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841998.469163:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500708096:12345-0@lo:400:kworker.0 Request processed in 33us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841998.469170:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788841998.469182:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788841998.469188:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500708224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841998.469214:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500708224:12345-0@lo:400:kworker.0 Request processed in 26us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841998.469220:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788841998.469265:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7668a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500708224:0@lo:400:kworker.0 00000100:00100000:0.0:1788841998.469276:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7668bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500708096:0@lo:400:kworker.0 00000100:00100000:0.0:1788841998.469284:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500708608:0@lo:400:kworker.0 00000100:00100000:1.0:1788841998.469383:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500707968:0@lo:400:kworker.0 00000100:00100000:1.0:1788841998.469421:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841998.469452:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7668b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875736500708480:0@lo:400:kworker.0 00000100:00100000:1.0:1788841998.469476:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841998.469497:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788841998.469502:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7668a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500708352:0@lo:400:kworker.0 00000100:00100000:1.0:1788841998.469524:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788841998.469545:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788841998.469551:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788841998.469562:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500708480 00000100:00100000:1.0:1788841998.469571:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500708480 00000100:00100000:1.0:1788841998.469615:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788841998.469621:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875736500708480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841998.469654:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875736500708480:12345-0@lo:400:kworker.0 Request processed in 34us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841998.469659:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:1.0:1788841998.469674:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788841998.469690:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7668b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875736500708480:0@lo:400:kworker.0 00000100:00100000:0.0:1788841998.469853:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500707968 00000100:00100000:0.0:1788841998.469857:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500707968 00000100:00100000:0.0:1788841998.469890:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788841998.469897:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3310:x1875736500707968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841998.470001:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3310:x1875736500707968:12345-0@lo:400:kworker.0 Request processed in 105us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841998.470008:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788841998.470035:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500708352 00000100:00100000:0.0:1788841998.470038:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500708352 00000100:00100000:0.0:1788841998.470064:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788841998.470070:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500708352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841998.470098:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500708352:12345-0@lo:400:kworker.0 Request processed in 29us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841998.470104:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788841998.470237:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7668a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500708352:0@lo:400:kworker.0 00000100:00100000:3.0:1788841998.470246:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500707968:0@lo:400:kworker.0 00000100:00080000:1.0:1788841998.470302:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788841998.821645:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841998.821813:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489164160 00000100:00100000:0.0:1788841998.821829:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489164160 00000100:00100000:0.0:1788841998.821937:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 137 00000100:00100000:0.0:1788841998.821950:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+13:11309:x1875736489164160:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788841998.821977:0:6963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841998.822006:0:6963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8ba26 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2304 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841998.822123:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8ba2d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841998.822143:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8ba2d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841998.822170:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8ba2d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841998.822191:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8ba34 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841998.822200:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8ba34 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841998.822206:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8ba34 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841998.823005:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8ba3b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841998.823020:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8ba3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841998.823028:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8ba3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788841998.823040:0:6963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788841998.823241:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8ba2d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841998.823249:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8ba2d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841998.823256:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8ba2d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841998.823262:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78e800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841998.823274:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8ba2d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788841998.823866:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788841998.823939:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8ba2d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841998.823957:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d3a821d0700) 00010000:00010000:0.0:1788841998.823961:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841998.823967:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8ba2d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841998.823974:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8ba2d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841998.823992:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8ba34 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841998.823999:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8ba34 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841998.824006:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8ba34 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841998.824012:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78e200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788841998.824016:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8ba34 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841998.824022:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8ba34 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841998.824030:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d3a4e719300) 00010000:00010000:0.0:1788841998.824033:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841998.824047:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8ba34 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841998.824053:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8ba34 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841998.829270:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8ba26 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2304 expref: 16 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841998.829308:0:6963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8ba3b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2304 expref: 15 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841998.829320:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d3a428df000) 00010000:00010000:0.0:1788841998.829323:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841998.829328:0:6963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78f000, rc 0) 00000100:00100000:0.0:1788841998.829441:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+15:11309:x1875736489164160:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 7492us (7809us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788841998.829451:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 137 00000100:00100000:2.0:1788841998.840827:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788841998.840866:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788841998.841017:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489164288 00000100:00100000:0.0:1788841998.841031:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489164288 00000100:00100000:0.0:1788841998.841128:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:0.0:1788841998.841141:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76688a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+15:2350:x1875736489164288:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788841998.841162:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788841998.841197:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8ba3b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2304 expref: 15 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841998.841221:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d3a428df000) 00010000:00010000:0.0:1788841998.841227:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788841998.841326:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76688a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+14:2350:x1875736489164288:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 187us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841998.841335:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:3.0:1788841998.841761:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489164416 00000100:00100000:3.0:1788841998.841767:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489164416 00000100:00100000:3.0:1788841998.841809:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 138 00000100:00100000:3.0:1788841998.841818:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7668a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+14:11309:x1875736489164416:12345-192.168.204.55@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788841998.841921:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7668a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+14:11309:x1875736489164416:12345-192.168.204.55@tcp:59:lhsmtool_posix.0 Request processed in 104us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841998.841929:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 138 00000100:00100000:0.0:1788841998.978061:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7668b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500708736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788841998.978201:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841998.978380:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500708736 00000100:00100000:1.0:1788841998.978391:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500708736 00000100:00100000:1.0:1788841998.978456:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788841998.978467:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75dbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500708736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788841998.978514:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788841998.978581:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75dbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500708736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841998.978588:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788841998.979883:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7668b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500708736:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788841999.234354:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788841999.426086:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788841999.426110:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788841999.426629:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788841999.426641:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1788842000.088445:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:1.0:1788842000.258344:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788842001.025997:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500708864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788842001.026081:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842001.026162:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500708864 00000100:00100000:1.0:1788842001.026169:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500708864 00000100:00100000:1.0:1788842001.026224:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788842001.026233:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500708864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788842001.026276:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788842001.026326:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500708864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842001.026334:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1788842001.026354:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788842001.026391:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500708864:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788842001.286548:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788842001.293769:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842001.293863:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489164544 00000100:00100000:3.0:1788842001.293877:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489164544 00000100:00080000:1.0:1788842001.293955:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788842001.293971:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 139 00000100:00100000:3.0:1788842001.293984:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+13:11352:x1875736489164544:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1788842001.294026:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842001.294063:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8ba49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef230b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.294156:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8ba50 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.294188:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8ba50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.294200:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8ba50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.294218:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8ba57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.294225:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8ba57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.294231:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8ba57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.294483:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8ba50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.294491:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8ba50 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.294498:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8ba50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.294505:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40031400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842001.294515:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8ba50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.294524:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8ba50 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.294538:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a4e719900) 00010000:00010000:3.0:1788842001.294541:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788842001.294548:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8ba50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.294554:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8ba50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.294566:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8ba57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.294572:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8ba57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.294578:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8ba57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.294583:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43531800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842001.294585:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8ba57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.294591:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8ba57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.294599:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d3a821d0300) 00010000:00010000:3.0:1788842001.294601:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788842001.294609:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8ba57 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.294614:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8ba57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.294651:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8ba49 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef230b expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.294664:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a4e719900) 00010000:00010000:3.0:1788842001.294667:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788842001.294671:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8ba49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef230b expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.294683:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40031000, rc 0) 00000100:00100000:3.0:1788842001.294775:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+13:11352:x1875736489164544:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 794us (1015us total) trans 0 rc 301/301 00000100:00100000:3.0:1788842001.294783:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 139 00000100:00100000:1.0:1788842001.309845:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842001.309968:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489164800 00000100:00100000:2.0:1788842001.309984:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489164800 00000100:00100000:2.0:1788842001.310075:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 140 00000100:00100000:2.0:1788842001.310099:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+13:11352:x1875736489164800:12345-192.168.204.55@tcp:36:lfs.0 00010000:00010000:2.0:1788842001.310182:0:6963:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788842001.310221:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8b3c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2144 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.310242:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a4e719900) 00010000:00010000:2.0:1788842001.310250:0:6963:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788842001.310535:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8ba5e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.310553:0:6963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8ba1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22fd expref: 5 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.310577:0:6963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8ba5e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.310622:0:6963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8ba1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22fd expref: 5 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.310816:0:6963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8ba1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22fd expref: 5 pid: 5852 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842001.310834:0:6963:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76688000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6963:1875736500708992:192.168.204.55@tcp:104: 00000100:00100000:2.0:1788842001.310955:0:6963:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a6193a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788842001.324431:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842001.324485:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842001.324519:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842001.324542:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842001.324575:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842001.324613:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489165312 00000100:00100000:2.0:1788842001.324635:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489165312 00000100:00100000:2.0:1788842001.324735:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 158 00000100:00100000:2.0:1788842001.324748:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7668a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419331f1-87f8-40c5-a1c8-5f66078f5ec5+6:2351:x1875736489165312:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788842001.324847:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7668a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419331f1-87f8-40c5-a1c8-5f66078f5ec5+6:2351:x1875736489165312:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 101us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842001.324856:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 158 00000100:00100000:2.0:1788842001.324885:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489165056 00000100:00100000:2.0:1788842001.324889:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489165056 00000100:00100000:2.0:1788842001.324925:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489165184 00000100:00100000:2.0:1788842001.324940:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489165184 00000100:00100000:0.0:1788842001.324950:0:6963:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76688000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6963:1875736500708992:192.168.204.55@tcp:104: 00000100:00100000:2.0:1788842001.324966:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 90 00000100:00100000:2.0:1788842001.324972:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7668bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2351:x1875736489165056:12345-192.168.204.55@tcp:400:kworker.0 00010000:00010000:0.0:1788842001.324985:0:6963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8ba5e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842001.325000:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7668bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2351:x1875736489165056:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 29us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842001.325007:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 90 00000100:00100000:2.0:1788842001.325017:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 91 00000100:00100000:2.0:1788842001.325024:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7668b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2351:x1875736489165184:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788842001.325051:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7668b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2351:x1875736489165184:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 27us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842001.325067:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 91 00000100:00100000:1.0:1788842001.325276:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489164928 00000100:00100000:1.0:1788842001.325281:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489164928 00000100:00100000:1.0:1788842001.325321:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 297 00000100:00100000:1.0:1788842001.325330:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2351:x1875736489164928:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788842001.325363:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2351:x1875736489164928:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 35us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842001.325370:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 297 00000100:00080000:1.0:1788842001.325408:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788842001.325413:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788842001.325416:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788842001.326173:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489165440 00000100:00100000:2.0:1788842001.326180:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489165440 00010000:00010000:2.0:1788842001.326211:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8ba1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22fd expref: 6 pid: 5852 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842001.327885:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 61 00000100:00100000:2.0:1788842001.327908:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b778e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+6:2349:x1875736489165440:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788842001.327930:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788842001.327941:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8ba1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22fd expref: 6 pid: 5852 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.327959:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8ba1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22fd expref: 6 pid: 5852 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.327987:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8ba1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22fd expref: 6 pid: 5852 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.328022:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a4e719900) 00010000:00010000:2.0:1788842001.328029:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8ba5e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.328040:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8ba5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.328050:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8ba5e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.328215:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788842001.328292:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b778e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2349:x1875736489165440:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 393us (3715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842001.328302:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 61 00010000:00010000:0.0:1788842001.328414:0:6963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8ba5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.328425:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8ba5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.328458:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8ba65 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.328471:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8ba65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.328481:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8ba65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788842001.337448:0:6963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788842001.337477:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8ba5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.337492:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8ba5e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.337501:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8ba5e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.337509:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842001.337515:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8ba5e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.337525:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8ba5e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.337548:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a4e719900) 00010000:00010000:0.0:1788842001.337552:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842001.337558:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8ba5e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.337565:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8ba5e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788842001.337589:0:6963:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004633a5eb reply state 00000000014bb89b transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8ba65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842001.337602:0:6963:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788842001.338078:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+14:11352:x1875736489164800:12345-192.168.204.55@tcp:36:lfs.0 Request processed in 27975us (28241us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788842001.338287:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 140 00010000:00010000:0.0:1788842001.347022:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8ba65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.347062:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8ba65 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.347072:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8ba65 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.347088:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78ec00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842001.347096:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8ba65 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.347106:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8ba65 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.347127:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d3a4e719300) 00010000:00010000:0.0:1788842001.347132:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842001.347138:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8ba65 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.347145:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8ba65 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842001.503479:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842001.505615:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489165568 00000100:00100000:3.0:1788842001.505631:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489165568 00000100:00100000:3.0:1788842001.505741:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 141 00000100:00100000:3.0:1788842001.505752:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+13:11360:x1875736489165568:12345-192.168.204.55@tcp:101:lctl.0 00010000:00010000:3.0:1788842001.505777:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842001.505801:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8ba6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2312 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.505883:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8ba73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.505915:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8ba73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.505928:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8ba73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788842001.505964:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788842001.505969:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788842001.505992:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8ba73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.506015:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8ba6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2312 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.506031:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8ba73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2312 expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.506039:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a821d0300) 00010000:00010000:3.0:1788842001.506042:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788842001.506045:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43530400, rc 0) 00000100:00100000:3.0:1788842001.506132:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+14:11360:x1875736489165568:12345-192.168.204.55@tcp:101:lctl.0 Request processed in 381us (2661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842001.506139:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 141 00000100:00100000:0.0:1788842001.589176:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842001.589257:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489165696 00000100:00100000:2.0:1788842001.589266:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489165696 00000100:00100000:2.0:1788842001.589319:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 142 00000100:00100000:2.0:1788842001.589329:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+14:11366:x1875736489165696:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:2.0:1788842001.589348:0:8623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842001.589367:0:8623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8ba7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2319 expref: -99 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.589425:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8ba81 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.589440:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8ba81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.589452:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8ba81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.589479:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8ba88 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.589487:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8ba88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.589494:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8ba88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.590448:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8ba8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.590460:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8ba8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.590480:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8ba8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788842001.590591:0:8623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788842001.590595:0:8623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788842001.590615:0:8623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8ba8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.590627:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8ba81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.590633:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8ba81 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.590640:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8ba81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.590646:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cca00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842001.590651:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8ba81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.590658:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8ba81 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.590670:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a821d0300) 00010000:00010000:3.0:1788842001.590673:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788842001.590677:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8ba81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.590693:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8ba81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.590735:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8ba88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.590741:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8ba88 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.590747:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8ba88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.590752:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cdc00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842001.590756:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8ba88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.590761:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8ba88 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.590768:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d3a61283900) 00010000:00010000:3.0:1788842001.590771:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788842001.590774:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8ba88 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.590780:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8ba88 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.590811:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8ba7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2319 expref: 16 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.590824:0:8623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8ba8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2319 expref: 15 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.590842:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:3.0:1788842001.590844:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788842001.590846:0:8623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43531800, rc 0) 00000100:00100000:3.0:1788842001.590960:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+15:11366:x1875736489165696:12345-192.168.204.55@tcp:101:bash.0 Request processed in 1633us (1794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842001.590969:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 142 00000100:00100000:0.0:1788842001.602551:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842001.602766:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489165952 00000100:00100000:2.0:1788842001.602776:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489165952 00000100:00100000:2.0:1788842001.602825:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 143 00000100:00100000:2.0:1788842001.602834:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+15:11366:x1875736489165952:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:2.0:1788842001.602854:0:6963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842001.602872:0:6963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8ba96 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2320 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.602991:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8ba9d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.603005:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8ba9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.603020:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8ba9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.603083:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8baa4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.603091:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8baa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.603111:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8baa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788842001.603609:0:6963:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788842001.603779:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8baab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.603789:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8baab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.603797:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8baab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.603826:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8ba9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.603833:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8ba9d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.603840:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8ba9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.603846:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cc000 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842001.603850:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8ba9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.603857:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8ba9d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.603868:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:2.0:1788842001.603871:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842001.603881:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8ba9d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.603888:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8ba9d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788842001.603901:0:6963:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf244a77 reply state 000000004aacb4de transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8baa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842001.603910:0:6963:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788842001.603940:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8ba96 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2320 expref: 18 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.603954:0:6963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8baab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2320 expref: 17 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.603961:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a61283a00) 00010000:00010000:2.0:1788842001.603964:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788842001.603966:0:6963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cc400, rc 0) 00000100:00100000:2.0:1788842001.604026:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+18:11366:x1875736489165952:12345-192.168.204.55@tcp:101:bash.0 Request processed in 1193us (1485us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788842001.604034:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 143 00010000:00010000:0.0:1788842001.609102:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8baa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.609119:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8baa4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.609139:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8baa4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.609146:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cce00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842001.609150:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8baa4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.609158:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8baa4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.609179:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3a61283b00) 00010000:00010000:0.0:1788842001.609182:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842001.609187:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8baa4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.609193:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8baa4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842001.614057:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842001.614146:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489166080 00000100:00100000:2.0:1788842001.614156:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489166080 00000100:00100000:2.0:1788842001.614202:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 47 00000100:00100000:2.0:1788842001.614211:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2351:x1875736489166080:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:2.0:1788842001.614227:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842001.614248:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003326e811/0x3de1064d33a8bab9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2327 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788842001.614291:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788842001.614309:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=329s v=(0 0) 00010000:00010000:2.0:1788842001.614314:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788842001.614323:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003326e811/0x3de1064d33a8bab9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2327 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.614350:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003326e811/0x3de1064d33a8bab9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2327 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.614364:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cd600, rc 0) 00000100:00100000:2.0:1788842001.614422:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2351:x1875736489166080:12345-192.168.204.55@tcp:101:bash.0 Request processed in 212us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842001.614430:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 47 00000100:00100000:1.0:1788842001.617124:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842001.617220:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489166208 00000100:00100000:2.0:1788842001.617228:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489166208 00000100:00100000:2.0:1788842001.617282:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 48 00000100:00100000:2.0:1788842001.617292:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:11366:x1875736489166208:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:2.0:1788842001.617307:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842001.617332:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8bac0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef232e expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.617362:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003326e811/0x3de1064d33a8bab9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2327 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.617390:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788842001.617394:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788842001.617400:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8bac0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef232e expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.617432:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003326e811/0x3de1064d33a8bab9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2327 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.617445:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003326e811/0x3de1064d33a8bab9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2327 expref: 7 pid: 6693 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842001.617459:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b778a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1875736500709120:192.168.204.55@tcp:104: 00000100:00100000:2.0:1788842001.617546:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788842001.620553:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b778a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1875736500709120:192.168.204.55@tcp:104: 00010000:00010000:2.0:1788842001.620589:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8bac0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef232e expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.620609:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cc000, rc 0) 00000100:00100000:2.0:1788842001.620666:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:11366:x1875736489166208:12345-192.168.204.55@tcp:101:bash.0 Request processed in 3376us (3550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842001.620675:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 48 00000100:00100000:1.0:1788842001.622999:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842001.623134:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489166336 00000100:00100000:0.0:1788842001.623143:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489166336 00010000:00010000:0.0:1788842001.623180:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003326e811/0x3de1064d33a8bab9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2327 expref: 7 pid: 6693 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842001.623220:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 62 00000100:00100000:0.0:1788842001.623228:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c211180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2349:x1875736489166336:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788842001.623242:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788842001.623263:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003326e811/0x3de1064d33a8bab9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2327 expref: 7 pid: 6693 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.623288:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003326e811/0x3de1064d33a8bab9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2327 expref: 7 pid: 6693 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.623310:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003326e811/0x3de1064d33a8bab9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2327 expref: 7 pid: 6693 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.623383:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842001.623388:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842001.623397:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8bac0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef232e expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.623407:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8bac0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef232e expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.623444:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8bac0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef232e expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842001.623459:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76805500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5836:1875736500709248:192.168.204.55@tcp:105: 00000100:00100000:0.0:1788842001.623573:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a429d8840 going to sleep for 11 seconds 00000100:00100000:1.0:1788842001.628077:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842001.628620:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489166592 00000100:00100000:3.0:1788842001.628630:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489166592 00000100:00100000:3.0:1788842001.628695:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 36 00000100:00100000:3.0:1788842001.631962:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+17:11366:x1875736489166592:12345-192.168.204.55@tcp:35:bash.0 00000100:00100000:3.0:1788842001.632317:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+18:11366:x1875736489166592:12345-192.168.204.55@tcp:35:bash.0 Request processed in 3612us (4250us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788842001.632339:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 36 00000100:00100000:0.0:1788842001.636896:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76805500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5836:1875736500709248:192.168.204.55@tcp:105: 00010000:00010000:0.0:1788842001.636928:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788842001.636990:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c211180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2349:x1875736489166336:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 13762us (13999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842001.637000:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 62 00000100:00100000:1.0:1788842001.765508:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842001.765595:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489166848 00000100:00100000:3.0:1788842001.765605:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489166848 00000100:00100000:3.0:1788842001.765670:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 144 00000100:00100000:3.0:1788842001.765685:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+18:11376:x1875736489166848:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1788842001.765748:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842001.765769:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8bac7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2335 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788842001.765865:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788842001.765978:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8bac7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2335 expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.766008:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a821d0300) 00010000:00010000:3.0:1788842001.766011:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788842001.766017:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8bac7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2335 expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.766031:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43530800, rc 0) 00000100:00100000:3.0:1788842001.766099:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+19:11376:x1875736489166848:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 415us (600us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1788842001.766107:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 144 00000100:00100000:1.0:1788842001.770246:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842001.770358:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489167104 00000100:00100000:0.0:1788842001.770368:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489167104 00000100:00100000:0.0:1788842001.770425:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 37 00000100:00100000:0.0:1788842001.770436:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+19:11376:x1875736489167104:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:0.0:1788842001.770663:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+20:11376:x1875736489167104:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 229us (426us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1788842001.770672:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 37 00000100:00100000:1.0:1788842001.869182:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842001.869282:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489167232 00000100:00100000:3.0:1788842001.869292:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489167232 00000100:00100000:3.0:1788842001.869364:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 145 00000100:00100000:3.0:1788842001.869374:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+20:11382:x1875736489167232:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1788842001.869398:0:8623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842001.869417:0:8623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8bad5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef233c expref: -99 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.869483:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8badc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.869496:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8badc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.869508:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8badc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788842001.870119:0:8623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788842001.870138:0:8623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788842001.870163:0:8623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8badc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.870195:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8bad5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef233c expref: 22 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.870214:0:8623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8badc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef233c expref: 21 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.870222:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:3.0:1788842001.870225:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788842001.870228:0:8623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43531e00, rc 0) 00000100:00100000:3.0:1788842001.870297:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+21:11382:x1875736489167232:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 924us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842001.870304:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 145 00000100:00100000:1.0:1788842001.880561:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842001.880683:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489167488 00000100:00100000:0.0:1788842001.880694:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489167488 00000100:00100000:0.0:1788842001.880807:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 146 00000100:00100000:0.0:1788842001.880819:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+21:11382:x1875736489167488:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1788842001.880843:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842001.880868:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bae3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2343 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.880981:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8baea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.880997:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8baea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.881008:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8baea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788842001.881021:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788842001.881168:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bae3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2343 expref: 24 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.881194:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8baea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2343 expref: 23 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.881213:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a61283a00) 00010000:00010000:0.0:1788842001.881215:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788842001.881231:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78e800, rc 0) 00000100:00100000:0.0:1788842001.881302:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+23:11382:x1875736489167488:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 485us (762us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1788842001.881310:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 146 00000100:00100000:1.0:1788842001.889535:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842001.889589:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842001.889735:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489167872 00000100:00100000:3.0:1788842001.889746:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489167872 00000100:00100000:3.0:1788842001.889820:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:3.0:1788842001.889833:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c212300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+23:2352:x1875736489167872:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788842001.889848:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788842001.889876:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8baea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2343 expref: 23 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.889900:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a61283a00) 00010000:00010000:3.0:1788842001.889906:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788842001.889970:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c212300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+22:2352:x1875736489167872:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 140us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842001.889997:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:0.0:1788842001.890136:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489167744 00000100:00100000:0.0:1788842001.890142:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489167744 00000100:00100000:0.0:1788842001.890178:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 147 00000100:00100000:0.0:1788842001.890185:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+22:11382:x1875736489167744:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1788842001.890205:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842001.890229:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8baf8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef234a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.892695:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8baff lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.892733:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8baff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.892748:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8baff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788842001.892774:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788842001.892942:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8baf8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef234a expref: 25 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.892997:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8baff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef234a expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.893006:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a61283a00) 00010000:00010000:0.0:1788842001.893009:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788842001.893012:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78e200, rc 0) 00000100:00100000:0.0:1788842001.893078:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+24:11382:x1875736489167744:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 2893us (3488us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1788842001.893086:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 147 00000100:00100000:1.0:1788842001.905492:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842001.906284:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489168000 00000100:00100000:2.0:1788842001.906297:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489168000 00000100:00100000:2.0:1788842001.906473:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 49 00000100:00100000:2.0:1788842001.906500:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2349:x1875736489168000:12345-192.168.204.55@tcp:1:lfs.0 00010000:00010000:2.0:1788842001.906562:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049d210b4/0x3de1064d33a8bb0d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.906583:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8bac0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef232e expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.906592:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788842001.906596:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788842001.906601:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049d210b4/0x3de1064d33a8bb0d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.906640:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8bac0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef232e expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.906655:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8bac0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef232e expref: 6 pid: 6695 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842001.906672:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b778a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1875736500709376:192.168.204.55@tcp:104: 00000100:00100000:2.0:1788842001.907062:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788842001.911353:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842001.911820:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489168128 00000100:00100000:3.0:1788842001.911832:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489168128 00002000:00100000:3.0:1788842001.911886:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8d3a7b779500 x1875736489168128/t0(0) o4->090c7b3c-cdb1-4c0e-9553-671552ee3fa2@192.168.204.55@tcp:127/0 lens 504/0 e 0 to 0 dl 1788842012 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788842001.911898:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3a7b779500 with x1875736489168128 ext(0->12) 00010000:00010000:3.0:1788842001.911908:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8bac0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef232e expref: 7 pid: 6695 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.911925:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8bac0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef232e expref: 7 pid: 6695 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788842001.911933:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d3a7b779500 00000100:00100000:3.0:1788842001.911970:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 2 00000100:00100000:3.0:1788842001.911981:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2350:x1875736489168128:12345-192.168.204.55@tcp:4:lfs.0 00000100:00100000:3.0:1788842001.912951:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:2350:x1875736489168128:12345-192.168.204.55@tcp:4:lfs.0 Request processed in 968us (1604us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788842001.912962:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 2 00002000:00100000:3.0:1788842001.912971:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8d3a7b779500 x1875736489168128/t4294967305(0) o4->090c7b3c-cdb1-4c0e-9553-671552ee3fa2@192.168.204.55@tcp:127/0 lens 504/448 e 0 to 0 dl 1788842012 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788842001.912979:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3a7b779500 with x1875736489168128 ext(0->12) 00010000:00010000:3.0:1788842001.912987:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8bac0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef232e expref: 9 pid: 6695 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.913016:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8bac0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef232e expref: 9 pid: 6695 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788842001.913024:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d3a7b779500 00000100:00100000:1.0:1788842001.918261:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842001.918577:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489168256 00000100:00100000:2.0:1788842001.918590:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489168256 00010000:00010000:2.0:1788842001.918645:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8bac0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef232e expref: 9 pid: 6695 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842001.918736:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 63 00000100:00100000:2.0:1788842001.918766:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c211c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:2350:x1875736489168256:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788842001.918785:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788842001.918808:0:8449:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788842001.918811:0:8449:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788842000 00002000:00010000:2.0:1788842001.918813:0:8449:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788842001 00002000:00010000:2.0:1788842001.918815:0:8449:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788842000 00010000:00010000:2.0:1788842001.918821:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8bac0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef232e expref: 9 pid: 6695 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.918838:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8bac0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef232e expref: 9 pid: 6695 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.918868:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788842001.918872:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788842001.918878:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049d210b4/0x3de1064d33a8bb0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.918888:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049d210b4/0x3de1064d33a8bb0d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842001.918914:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788842001.918978:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c211c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:2350:x1875736489168256:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 215us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842001.918987:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 63 00010000:00010000:0.0:1788842001.921248:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8bac0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef232e expref: 8 pid: 6695 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842001.921274:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b778a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6693:1875736500709376:192.168.204.55@tcp:104: 00010000:00010000:0.0:1788842001.921300:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000049d210b4/0x3de1064d33a8bb0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.921313:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000049d210b4/0x3de1064d33a8bb0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.921329:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049d210b4/0x3de1064d33a8bb0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.921366:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049d210b4/0x3de1064d33a8bb0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.921396:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049d210b4/0x3de1064d33a8bb0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.921404:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049d210b4/0x3de1064d33a8bb0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.921411:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cc200 already unused, calling callback (ffffffffc1813420) 00010000:00010000:0.0:1788842001.921415:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049d210b4/0x3de1064d33a8bb0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.921424:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049d210b4/0x3de1064d33a8bb0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.921444:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049d210b4/0x3de1064d33a8bb0d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.921451:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049d210b4/0x3de1064d33a8bb0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842001.921552:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2349:x1875736489168000:12345-192.168.204.55@tcp:1:lfs.0 Request processed in 15048us (16062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842001.921562:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 49 00000100:00100000:1.0:1788842001.928073:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842001.928164:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489168512 00000100:00100000:0.0:1788842001.928176:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489168512 00000100:00100000:0.0:1788842001.928240:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 38 00000100:00100000:0.0:1788842001.928267:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a658d9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+24:11382:x1875736489168512:12345-192.168.204.55@tcp:35:lfs.0 00000004:00010000:0.0:1788842001.928332:0:5853:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8baff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef234a expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788842001.928603:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1788842001.928650:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1788842001.929232:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1788842001.929296:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb14 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.929313:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8baab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2320 expref: 28 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.929323:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb14 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.929368:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8baab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2320 expref: 28 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.929383:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8baab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2320 expref: 28 pid: 6963 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842001.929397:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76805500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1875736500709504:192.168.204.55@tcp:104: 00000100:00100000:0.0:1788842001.929483:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a429d8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788842001.936555:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842001.936682:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489168640 00000100:00100000:3.0:1788842001.936704:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489168640 00010000:00010000:3.0:1788842001.936779:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8baab lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2320 expref: 29 pid: 6963 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842001.936823:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 64 00000100:00100000:3.0:1788842001.936832:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4ec18050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+29:2349:x1875736489168640:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788842001.936846:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788842001.936852:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8baab lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2320 expref: 29 pid: 6963 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.936866:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8baab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2320 expref: 29 pid: 6963 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.936893:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a61283a00) 00010000:00010000:3.0:1788842001.936898:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb14 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.936907:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb14 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.936914:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb14 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.936947:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788842001.937002:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4ec18050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+29:2349:x1875736489168640:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 171us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842001.937009:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 64 00010000:00010000:0.0:1788842001.939116:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8baab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2320 expref: 28 pid: 6963 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842001.939144:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76805500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1875736500709504:192.168.204.55@tcp:104: 00010000:00010000:0.0:1788842001.939193:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb14 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.939204:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb14 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.939211:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb14 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788842001.939500:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788842001.940159:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1788842001.940290:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76805500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875736500709632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788842001.940375:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842001.940405:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a61969900 going to sleep for 11 seconds 00000100:00100000:1.0:1788842001.941530:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500709632 00000100:00100000:1.0:1788842001.941541:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500709632 00000100:00100000:1.0:1788842001.941645:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788842001.941655:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1875736500709632:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788842001.941811:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1875736500709632:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 158us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842001.941819:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788842001.941970:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788842001.942507:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76805500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875736500709632:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788842001.944332:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1788842001.944427:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76805500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875736500709760:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788842001.944495:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842001.944539:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a47a7ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788842001.944609:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500709760 00000100:00100000:3.0:1788842001.944617:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500709760 00000100:00100000:3.0:1788842001.944665:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788842001.944675:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1875736500709760:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788842001.944876:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5853:x1875736500709760:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 202us (380us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788842001.944884:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788842001.945198:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76805500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875736500709760:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788842001.945424:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1788842001.945469:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb14 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.945479:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb14 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.945486:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb14 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.945506:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78fc00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842001.945511:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb14 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.945522:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb14 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.945538:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a61283a00) 00010000:00010000:0.0:1788842001.945540:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788842001.945668:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb14 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842001.945675:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb14 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788842001.948991:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788842001.949141:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1788842001.949154:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 330106444192ns, next at 331106440672ns, rc = 0 00000001:00080000:0.0:1788842001.949166:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1788842001.951954:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a61283a00) 00010000:00010000:0.0:1788842001.951965:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788842001.951978:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8baff lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef234a expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842001.952161:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a658d9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+31:11382:x1875736489168512:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 23895us (24097us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1788842001.952171:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 38 00000020:00080000:0.0:1788842001.952177:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788842001.960439:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842001.960739:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489168768 00000100:00100000:3.0:1788842001.960750:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489168768 00000100:00100000:3.0:1788842001.960808:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 148 00000100:00100000:3.0:1788842001.960819:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+31:11382:x1875736489168768:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1788842001.960842:0:8623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842001.960866:0:8623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8bb1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2351 expref: -99 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.960927:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8bb1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2351 expref: 32 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.960941:0:8623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8bb1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2351 expref: 32 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842001.960982:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a821d0c00) 00010000:00010000:3.0:1788842001.960985:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788842001.960989:0:8623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a43530800, rc 0) 00000100:00100000:3.0:1788842001.961086:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+32:11382:x1875736489168768:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 268us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842001.961093:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 148 00000100:00100000:1.0:1788842001.967002:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842001.967087:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489169024 00000100:00100000:3.0:1788842001.967098:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489169024 00000100:00100000:3.0:1788842001.967189:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 39 00000100:00100000:3.0:1788842001.967199:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+32:11382:x1875736489169024:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:3.0:1788842001.967444:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+33:11382:x1875736489169024:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 246us (453us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1788842001.967452:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 39 00000100:00100000:1.0:1788842002.087573:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842002.088262:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489169280 00000100:00100000:2.0:1788842002.088274:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489169280 00000100:00100000:2.0:1788842002.088351:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 149 00000100:00100000:2.0:1788842002.088377:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+33:11392:x1875736489169280:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1788842002.088401:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842002.088422:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8bb22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2358 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788842002.088512:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788842002.088641:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8bb22 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2358 expref: 35 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842002.088655:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a821d0300) 00010000:00010000:2.0:1788842002.088658:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788842002.088664:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8bb22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2358 expref: 35 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842002.088679:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cc400, rc 0) 00000100:00100000:2.0:1788842002.088788:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+34:11392:x1875736489169280:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 412us (1277us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788842002.088795:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 149 00000100:00100000:1.0:1788842002.093633:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842002.093729:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489169408 00000100:00100000:0.0:1788842002.093739:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489169408 00000100:00100000:0.0:1788842002.094018:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 150 00000100:00100000:0.0:1788842002.094030:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+34:11392:x1875736489169408:12345-192.168.204.55@tcp:34:lfs.0 00010000:00010000:0.0:1788842002.094118:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bb30 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094136:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bb30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094146:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bb30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094159:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094165:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094171:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094265:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bb3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094273:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bb3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094280:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bb3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788842002.094334:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bb3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094360:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bb30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094366:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bb30 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094374:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bb30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094380:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78e200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842002.094385:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bb30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094393:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bb30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094405:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:0.0:1788842002.094408:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842002.094412:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bb30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094419:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bb30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094437:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094444:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094451:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094460:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78fc00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842002.094464:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094471:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094478:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3a4e719300) 00010000:00010000:0.0:1788842002.094479:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842002.094482:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094487:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094501:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bb3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094506:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bb3e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094511:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bb3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094515:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f000 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842002.094517:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bb3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094523:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bb3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094541:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a821d0c00) 00010000:00010000:0.0:1788842002.094544:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842002.094547:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bb3e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.094552:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bb3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842002.094644:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+34:11392:x1875736489169408:12345-192.168.204.55@tcp:34:lfs.0 Request processed in 615us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842002.094651:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 150 00000100:00100000:1.0:1788842002.098663:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842002.099181:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489169664 00000100:00100000:0.0:1788842002.099192:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489169664 00000100:00100000:0.0:1788842002.099332:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 40 00000100:00100000:0.0:1788842002.099343:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+34:11392:x1875736489169664:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:0.0:1788842002.099854:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+35:11392:x1875736489169664:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 511us (1200us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788842002.099863:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 40 00000100:00100000:1.0:1788842002.206295:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842002.206414:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489169920 00000100:00100000:0.0:1788842002.206425:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489169920 00000100:00100000:0.0:1788842002.206495:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 151 00000100:00100000:0.0:1788842002.206505:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+35:11395:x1875736489169920:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1788842002.206534:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842002.206556:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bb45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef235f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.206633:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb4c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.206659:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.206668:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.206684:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bb53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.206705:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bb53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.206754:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bb53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.206888:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bb5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.206897:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bb5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.206904:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bb5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788842002.206913:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788842002.207008:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.207015:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb4c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.207021:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.207033:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78fc00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842002.207048:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.207056:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb4c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.207069:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:0.0:1788842002.207072:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842002.207076:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.207081:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.207100:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bb53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.207106:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bb53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.207111:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bb53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.207117:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78e200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842002.207119:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bb53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.207126:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bb53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.207143:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3a4e719300) 00010000:00010000:0.0:1788842002.207145:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842002.207148:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bb53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.207153:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bb53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.207201:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bb45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef235f expref: 38 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.207217:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bb5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef235f expref: 37 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.207224:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a821d0c00) 00010000:00010000:0.0:1788842002.207227:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788842002.207229:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78f600, rc 0) 00000100:00100000:0.0:1788842002.207289:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+37:11395:x1875736489169920:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 786us (1004us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1788842002.207297:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 151 00000100:00100000:1.0:1788842002.215746:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842002.215962:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489170048 00000100:00100000:3.0:1788842002.215981:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489170048 00000100:00100000:3.0:1788842002.216058:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 152 00000100:00100000:3.0:1788842002.216069:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+37:11395:x1875736489170048:12345-192.168.204.55@tcp:54:lfs.0 00010000:00010000:3.0:1788842002.216138:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8bb68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842002.216155:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8bb68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842002.216166:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8bb68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842002.216213:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8bb68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842002.216220:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8bb68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842002.216226:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8bb68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842002.216231:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40030c00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842002.216236:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8bb68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842002.216242:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8bb68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842002.216254:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a821d0c00) 00010000:00010000:3.0:1788842002.216257:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788842002.216261:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8bb68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842002.216267:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8bb68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842002.216359:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+37:11395:x1875736489170048:12345-192.168.204.55@tcp:54:lfs.0 Request processed in 292us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842002.216367:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 152 00000100:00100000:1.0:1788842002.222070:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842002.222204:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489170304 00000100:00100000:3.0:1788842002.222213:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489170304 00000100:00100000:3.0:1788842002.222275:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 41 00000100:00100000:3.0:1788842002.222303:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+37:11395:x1875736489170304:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:3.0:1788842002.222548:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+38:11395:x1875736489170304:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 247us (488us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788842002.222557:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 41 00010000:00010000:1.0:1788842002.305948:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788842002.596555:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842002.596796:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489170560 00000100:00100000:0.0:1788842002.596806:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489170560 00000100:00100000:0.0:1788842002.596872:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 153 00000100:00100000:0.0:1788842002.596883:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+38:11426:x1875736489170560:12345-192.168.204.55@tcp:101:cat.0 00010000:00010000:0.0:1788842002.596908:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842002.596930:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bb6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2366 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.597075:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bb76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.597090:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bb76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.597101:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bb76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788842002.597112:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788842002.597268:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bb6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2366 expref: 41 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.597293:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bb76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2366 expref: 40 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.597313:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a821d0c00) 00010000:00010000:0.0:1788842002.597316:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788842002.597320:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78e200, rc 0) 00000100:00100000:0.0:1788842002.597393:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+40:11426:x1875736489170560:12345-192.168.204.55@tcp:101:cat.0 Request processed in 511us (848us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788842002.597400:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 153 00000100:00100000:1.0:1788842002.609063:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842002.609177:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842002.609291:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489170688 00000100:00100000:2.0:1788842002.609302:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489170688 00000100:00100000:2.0:1788842002.609376:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:2.0:1788842002.609387:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+40:2351:x1875736489170688:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788842002.609403:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788842002.609428:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bb76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2366 expref: 40 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842002.609453:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a821d0c00) 00010000:00010000:2.0:1788842002.609474:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788842002.609551:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+39:2351:x1875736489170688:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 165us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842002.609559:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:3.0:1788842002.612774:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489170944 00000100:00100000:3.0:1788842002.612788:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489170944 00000100:00100000:3.0:1788842002.612861:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 42 00000100:00100000:3.0:1788842002.612871:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+39:11426:x1875736489170944:12345-192.168.204.55@tcp:35:cat.0 00000100:00100000:3.0:1788842002.613458:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+40:11426:x1875736489170944:12345-192.168.204.55@tcp:35:cat.0 Request processed in 587us (4278us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788842002.613467:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 42 00000100:00100000:1.0:1788842002.705871:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842002.706114:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489171200 00000100:00100000:2.0:1788842002.706125:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489171200 00000100:00100000:2.0:1788842002.706433:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 154 00000100:00100000:2.0:1788842002.706445:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+40:11432:x1875736489171200:12345-192.168.204.55@tcp:101:dd.0 00010000:00010000:2.0:1788842002.706469:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842002.706472:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788842002.706497:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531e00/0x3de1064d33a8badc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef233c expref: 40 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842002.706515:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:2.0:1788842002.706684:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788842002.706705:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8bb84 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef236d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842002.706849:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bb8b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842002.706863:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bb5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef235f expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842002.706872:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bb8b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842002.706906:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bb5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef235f expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842002.706941:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bb5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef235f expref: 40 pid: 5850 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842002.706956:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b778000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875736500709888:192.168.204.55@tcp:104: 00000100:00100000:2.0:1788842002.707067:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788842002.712778:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842002.712871:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489171328 00000100:00100000:1.0:1788842002.712881:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489171328 00010000:00010000:1.0:1788842002.712939:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bb5a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef235f expref: 41 pid: 5850 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842002.712981:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 65 00000100:00100000:1.0:1788842002.712991:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b779880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+41:2350:x1875736489171328:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788842002.713006:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788842002.713013:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bb5a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef235f expref: 41 pid: 5850 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842002.713025:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bb5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef235f expref: 41 pid: 5850 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842002.713059:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a821d0c00) 00010000:00010000:1.0:1788842002.713065:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bb8b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842002.713073:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bb8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842002.713082:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bb8b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842002.713100:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788842002.713218:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b779880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+41:2350:x1875736489171328:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 228us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842002.713226:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 65 00010000:00010000:3.0:1788842002.713444:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bb5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef235f expref: 40 pid: 5850 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842002.713466:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b778000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875736500709888:192.168.204.55@tcp:104: 00010000:00010000:3.0:1788842002.713489:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bb8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842002.713499:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bb8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842002.713505:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bb8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788842002.713538:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788842002.713731:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8bb84 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef236d expref: 41 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842002.713760:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bb8b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef236d expref: 40 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842002.713768:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a821d0c00) 00010000:00010000:3.0:1788842002.713771:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788842002.713774:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cd600, rc 0) 00000100:00100000:3.0:1788842002.713802:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+40:11432:x1875736489171200:12345-192.168.204.55@tcp:101:dd.0 Request processed in 7361us (8095us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788842002.713809:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 154 00000100:00100000:1.0:1788842002.718153:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842002.718402:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489171584 00000100:00100000:0.0:1788842002.718412:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489171584 00000100:00100000:0.0:1788842002.718506:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 155 00000100:00100000:0.0:1788842002.718517:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+40:11432:x1875736489171584:12345-192.168.204.55@tcp:36:dd.0 00010000:00010000:0.0:1788842002.718837:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb99 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.718868:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842002.718880:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788842002.718936:0:8623:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1788842002.718959:0:8623:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a440750 reply state 0000000053b8c90b transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842002.718968:0:8623:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788842002.719126:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+43:11432:x1875736489171584:12345-192.168.204.55@tcp:36:dd.0 Request processed in 610us (983us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788842002.719134:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 155 00000020:00080000:0.0:1788842002.719139:0:8623:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788842002.736467:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842002.736487:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb99 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842002.736495:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842002.736501:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78fc00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842002.736507:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842002.736515:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb99 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842002.736532:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a821d0c00) 00010000:00010000:2.0:1788842002.736535:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842002.736539:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb99 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842002.736546:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bb99 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842003.080624:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842003.080740:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489171712 00000100:00100000:0.0:1788842003.080751:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489171712 00000100:00100000:0.0:1788842003.080849:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 156 00000100:00100000:0.0:1788842003.080860:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+42:11446:x1875736489171712:12345-192.168.204.55@tcp:101:stat.0 00010000:00010000:0.0:1788842003.080884:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842003.080905:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8bba0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2374 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.080991:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bba7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.081005:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bba7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.081018:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bba7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.081059:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8bbae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.081065:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8bbae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.081072:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8bbae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.081160:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8bbb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.081172:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bb8b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef236d expref: 43 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.081179:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8bbb5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.081213:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bb8b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef236d expref: 43 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.081226:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bb8b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef236d expref: 43 pid: 5851 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842003.081239:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76805f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875736500710016:192.168.204.55@tcp:104: 00000100:00100000:0.0:1788842003.081344:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a429d8cc0 going to sleep for 11 seconds 00000100:00080000:3.0:1788842003.081731:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788842003.085410:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76805f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875736500710016:192.168.204.55@tcp:104: 00010000:00010000:1.0:1788842003.085456:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8bbb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842003.085757:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842003.086180:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489171968 00000100:00100000:0.0:1788842003.086189:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489171968 00000100:00100000:0.0:1788842003.086280:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 43 00000100:00100000:0.0:1788842003.086309:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+44:5590:x1875736489171968:12345-192.168.204.55@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788842003.086612:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+45:5590:x1875736489171968:12345-192.168.204.55@tcp:35:ldlm_bl.0 Request processed in 305us (855us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1788842003.086621:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 43 00000100:00100000:0.0:1788842003.095428:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842003.095544:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489172096 00000100:00100000:2.0:1788842003.095554:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489172096 00010000:00010000:2.0:1788842003.095598:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bb8b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef236d expref: 45 pid: 5851 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842003.095669:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 66 00000100:00100000:2.0:1788842003.095679:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76807b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+45:2349:x1875736489172096:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788842003.095695:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788842003.095701:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bb8b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef236d expref: 45 pid: 5851 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.095743:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bb8b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef236d expref: 45 pid: 5851 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.095776:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bb8b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef236d expref: 45 pid: 5851 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.095793:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a821d0c00) 00010000:00010000:2.0:1788842003.095800:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8bbb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.095810:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8bbb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.095817:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8bbb5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.095840:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788842003.095900:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8bbb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.095909:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8bbb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842003.095918:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76807b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+44:2349:x1875736489172096:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 241us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842003.095925:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 66 00000004:00200000:1.0:1788842003.095954:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788842003.095959:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788842003.095983:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8bbb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.095995:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8bbb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.096003:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bba7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.096011:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bba7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.096016:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bba7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.096034:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78e600 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788842003.096038:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bba7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.096045:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bba7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.096062:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:1.0:1788842003.096064:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788842003.096068:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bba7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.096074:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bba7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.096091:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8bbae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.096098:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8bbae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.096103:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8bbae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.096108:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788842003.096110:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8bbae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.096116:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8bbae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.096122:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3a4e719300) 00010000:00010000:1.0:1788842003.096124:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788842003.096127:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8bbae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.096132:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8bbae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.096179:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8bba0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2374 expref: 44 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.096193:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8bbb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2374 expref: 43 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.096201:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a821d0c00) 00010000:00010000:1.0:1788842003.096203:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788842003.096206:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78f800, rc 0) 00000100:00100000:1.0:1788842003.096247:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+43:11446:x1875736489171712:12345-192.168.204.55@tcp:101:stat.0 Request processed in 15390us (15634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842003.096254:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 156 00000100:00100000:0.0:1788842003.146237:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842003.146391:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489172352 00000100:00100000:3.0:1788842003.146402:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489172352 00000100:00100000:3.0:1788842003.146467:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 157 00000100:00100000:3.0:1788842003.146478:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+43:11452:x1875736489172352:12345-192.168.204.55@tcp:36:truncate.0 00010000:00010000:3.0:1788842003.146564:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788842003.146591:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8bbb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2374 expref: 43 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.146616:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a821d0c00) 00010000:00010000:3.0:1788842003.146622:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788842003.147686:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bbbc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.147705:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bbbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.147743:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bbbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788842003.147797:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788842003.147823:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e86b6ddd reply state 000000000ee9e112 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bbbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842003.147833:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788842003.147932:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+45:11452:x1875736489172352:12345-192.168.204.55@tcp:36:truncate.0 Request processed in 1454us (1705us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788842003.147941:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 157 00000020:00080000:2.0:1788842003.147946:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788842003.151197:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bbbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.151217:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bbbc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.151224:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bbbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.151231:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd600 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788842003.151236:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bbbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.151243:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bbbc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.151260:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a821d0c00) 00010000:00010000:1.0:1788842003.151278:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788842003.151283:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bbbc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.151290:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bbbc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842003.303391:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842003.303502:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489172480 00000100:00100000:3.0:1788842003.303513:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489172480 00000100:00100000:3.0:1788842003.303585:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 158 00000100:00100000:3.0:1788842003.303595:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+44:11466:x1875736489172480:12345-192.168.204.55@tcp:101:stat.0 00010000:00010000:3.0:1788842003.303618:0:8623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842003.303651:0:8623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8bbc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef237b expref: -99 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.303749:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8bbca lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.303763:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8bbca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.303784:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8bbca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.303873:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8bbd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.303881:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8bbd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.303888:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8bbd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.303983:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bbd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.303991:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bbd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.303998:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bbd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788842003.304047:0:8623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788842003.304052:0:8623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788842003.304070:0:8623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bbd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.304088:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bbd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.304096:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8bbca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.304101:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8bbca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.304107:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8bbca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.304112:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40030c00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842003.304116:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8bbca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.304122:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8bbca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.304133:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:3.0:1788842003.304136:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788842003.304140:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8bbca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.304146:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030c00/0x3de1064d33a8bbca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.304159:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8bbd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.304164:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8bbd1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.304174:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8bbd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.304179:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40031400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842003.304182:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8bbd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.304187:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8bbd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.304195:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3a821d0800) 00010000:00010000:3.0:1788842003.304197:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788842003.304199:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8bbd1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.304204:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031400/0x3de1064d33a8bbd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.304236:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8bbc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef237b expref: 46 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.304249:0:8623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bbd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef237b expref: 45 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.304255:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a821d0c00) 00010000:00010000:3.0:1788842003.304257:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788842003.304260:0:8623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60052800, rc 0) 00000100:00100000:3.0:1788842003.306818:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+45:11466:x1875736489172480:12345-192.168.204.55@tcp:101:stat.0 Request processed in 3210us (3422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842003.306852:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 158 00010000:00010000:1.0:1788842003.330807:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788842003.397303:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842003.397618:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489172736 00000100:00100000:1.0:1788842003.397630:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489172736 00000100:00100000:1.0:1788842003.397693:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 159 00000100:00100000:1.0:1788842003.397703:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+45:11476:x1875736489172736:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1788842003.397753:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788842003.397776:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ec00/0x3de1064d33a8bbdf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2382 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788842003.397882:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788842003.398010:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ec00/0x3de1064d33a8bbdf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2382 expref: 47 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.398037:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a821d0300) 00010000:00010000:1.0:1788842003.398040:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788842003.398046:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ec00/0x3de1064d33a8bbdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2382 expref: 47 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.398064:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c24ec00, rc 0) 00000100:00100000:1.0:1788842003.398141:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+46:11476:x1875736489172736:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 439us (848us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1788842003.398148:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 159 00000100:00100000:1.0:1788842003.406653:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842003.407562:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489172992 00000100:00100000:3.0:1788842003.407579:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489172992 00000100:00100000:3.0:1788842003.407651:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 44 00000100:00100000:3.0:1788842003.407664:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a658d9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+46:11476:x1875736489172992:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:3.0:1788842003.407964:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a658d9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+47:11476:x1875736489172992:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 301us (1319us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788842003.407971:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 44 00000100:00100000:2.0:1788842003.474343:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842003.474556:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489173248 00000100:00100000:0.0:1788842003.474572:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489173248 00000100:00100000:0.0:1788842003.474762:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 160 00000100:00100000:0.0:1788842003.474776:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b77a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+47:11482:x1875736489173248:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:0.0:1788842003.474812:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842003.474843:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8bbed lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2389 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.474985:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bbf4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.475005:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bbd8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef237b expref: 48 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.475031:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bbf4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.475093:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bbd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef237b expref: 48 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.475111:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bbd8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef237b expref: 48 pid: 8623 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842003.475150:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76804380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875736500710144:192.168.204.55@tcp:104: 00000100:00100000:0.0:1788842003.475299:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a429d8840 going to sleep for 11 seconds 00000100:00100000:0.0:1788842003.477466:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76804380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875736500710144:192.168.204.55@tcp:104: 00010000:00010000:0.0:1788842003.477507:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bbf4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842003.478315:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842003.481467:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489173376 00000100:00100000:1.0:1788842003.481490:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489173376 00010000:00010000:1.0:1788842003.481559:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bbd8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef237b expref: 49 pid: 8623 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842003.482470:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 67 00000100:00100000:1.0:1788842003.482491:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b77b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+49:2350:x1875736489173376:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788842003.482515:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788842003.482532:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bbd8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef237b expref: 49 pid: 8623 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.482549:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bbd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef237b expref: 49 pid: 8623 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.482579:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bbd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef237b expref: 49 pid: 8623 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.482613:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a821d0c00) 00010000:00010000:1.0:1788842003.482619:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bbf4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.482630:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bbf4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.482638:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bbf4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.482685:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788842003.482854:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b77b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+48:2350:x1875736489173376:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 371us (4541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842003.482863:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 67 00010000:00010000:0.0:1788842003.483177:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bbf4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.483189:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bbf4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788842003.483215:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788842003.483449:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8bbed lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2389 expref: 49 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.483479:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bbf4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2389 expref: 48 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.483488:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a821d0c00) 00010000:00010000:0.0:1788842003.483491:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788842003.483494:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78fe00, rc 0) 00000100:00100000:0.0:1788842003.483530:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b77a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+48:11482:x1875736489173248:12345-192.168.204.55@tcp:101:bash.0 Request processed in 8758us (9205us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1788842003.483538:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 160 00000100:00100000:1.0:1788842003.486431:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842003.486578:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489173632 00000100:00100000:3.0:1788842003.486591:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489173632 00000100:00100000:3.0:1788842003.486661:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 161 00000100:00100000:3.0:1788842003.486681:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+48:11482:x1875736489173632:12345-192.168.204.55@tcp:36:bash.0 00010000:00010000:3.0:1788842003.487123:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bc02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.487145:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bc02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.487159:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bc02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788842003.487223:0:8623:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1788842003.487250:0:8623:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac5683d0 reply state 0000000022ad74f4 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bc02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842003.487261:0:8623:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788842003.487382:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+51:11482:x1875736489173632:12345-192.168.204.55@tcp:36:bash.0 Request processed in 702us (966us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788842003.487407:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 161 00000020:00080000:3.0:1788842003.487413:0:8623:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788842003.491926:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bc02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.491951:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bc02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.491960:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bc02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.491990:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053e00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842003.491996:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bc02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.492005:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bc02 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.492039:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a821d0c00) 00010000:00010000:2.0:1788842003.492043:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842003.492048:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bc02 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.492054:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bc02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842003.496520:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842003.496644:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489173760 00000100:00100000:0.0:1788842003.496686:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489173760 00000100:00100000:0.0:1788842003.496963:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 162 00000100:00100000:0.0:1788842003.496977:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+50:11482:x1875736489173760:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:0.0:1788842003.497024:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842003.497051:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8bc09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2390 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.497192:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8bc10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.497210:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bbf4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2389 expref: 51 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.497219:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8bc10 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.497266:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bbf4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2389 expref: 51 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.497283:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bbf4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2389 expref: 51 pid: 5851 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842003.497302:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76804380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875736500710272:192.168.204.55@tcp:104: 00000100:00100000:0.0:1788842003.497425:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a429d8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788842003.500698:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842003.500951:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489173888 00000100:00100000:1.0:1788842003.500964:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489173888 00010000:00010000:1.0:1788842003.501037:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bbf4 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2389 expref: 52 pid: 5851 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842003.501083:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 68 00000100:00100000:1.0:1788842003.501096:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76805c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+52:2349:x1875736489173888:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788842003.501116:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788842003.501124:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bbf4 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2389 expref: 52 pid: 5851 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842003.501131:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76804380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875736500710272:192.168.204.55@tcp:104: 00010000:00010000:1.0:1788842003.501137:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bbf4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2389 expref: 52 pid: 5851 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.501163:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bbf4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2389 expref: 52 pid: 5851 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.504350:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8bc10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.504353:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a821d0c00) 00010000:00010000:1.0:1788842003.504364:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8bc10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.504377:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8bc10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842003.504412:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8bc10 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.504629:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788842003.504938:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76805c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+51:2349:x1875736489173888:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 3835us (4247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842003.504952:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 68 00010000:00010000:3.0:1788842003.505212:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8bc10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.505220:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8bc10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788842003.507140:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788842003.507153:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788842003.507193:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8bc10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.507243:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8bc09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2390 expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.507269:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8bc10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2390 expref: 50 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.507278:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a821d0c00) 00010000:00010000:2.0:1788842003.507280:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788842003.507283:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78fa00, rc 0) 00000100:00100000:2.0:1788842003.507440:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+50:11482:x1875736489173760:12345-192.168.204.55@tcp:101:bash.0 Request processed in 10465us (10934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842003.507467:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 162 00000100:00100000:0.0:1788842003.515522:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842003.515651:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489174144 00000100:00100000:2.0:1788842003.515676:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489174144 00000100:00100000:2.0:1788842003.515793:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 45 00000100:00100000:2.0:1788842003.515807:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+50:11482:x1875736489174144:12345-192.168.204.55@tcp:35:bash.0 00000100:00100000:2.0:1788842003.516121:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+51:11482:x1875736489174144:12345-192.168.204.55@tcp:35:bash.0 Request processed in 316us (615us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1788842003.516130:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 45 00000040:00080000:0.0:1788842003.522100:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788842003.522116:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788842003.522384:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1788842003.522396:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788842003.586780:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500710528:0@lo:400:kworker.0 00000100:00100000:0.0:1788842003.586887:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842003.586979:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500711040:0@lo:400:kworker.0 00000100:00100000:0.0:1788842003.587008:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842003.587062:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788842003.587068:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b778e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500710656:0@lo:400:kworker.0 00000100:00100000:0.0:1788842003.587092:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842003.587133:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500711040 00000100:00100000:0.0:1788842003.587142:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500711040 00000100:00100000:0.0:1788842003.587210:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788842003.587222:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875736500711040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788842003.587296:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875736500711040:12345-0@lo:400:kworker.0 Request processed in 63us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842003.587305:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1788842003.587333:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788842003.587373:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500711040:0@lo:400:kworker.0 00000100:00100000:0.0:1788842003.587400:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500710528 00000100:00100000:0.0:1788842003.587404:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500710528 00000100:00100000:0.0:1788842003.587429:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500710656 00000100:00100000:0.0:1788842003.587431:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500710656 00000100:00080000:0.0:1788842003.587447:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788842003.587466:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788842003.587472:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500710528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788842003.587519:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500710528:12345-0@lo:400:kworker.0 Request processed in 47us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842003.587525:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788842003.587548:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500710528:0@lo:400:kworker.0 00000100:00100000:0.0:1788842003.587565:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788842003.587572:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500710656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788842003.587604:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500710656:12345-0@lo:400:kworker.0 Request processed in 33us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842003.587610:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788842003.587631:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b778e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500710656:0@lo:400:kworker.0 00000100:00100000:3.0:1788842003.587809:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b778a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500710784:0@lo:400:kworker.0 00000100:00100000:3.0:1788842003.587858:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842003.587861:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b77aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500710400:0@lo:400:kworker.0 00000100:00100000:0.0:1788842003.587964:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842003.588115:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500710784 00000100:00100000:2.0:1788842003.588123:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500710784 00000100:00100000:0.0:1788842003.588124:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875736500710912:0@lo:400:kworker.0 00000100:00100000:2.0:1788842003.588187:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788842003.588189:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842003.588203:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500710784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788842003.588270:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500710784:12345-0@lo:400:kworker.0 Request processed in 72us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842003.588277:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1788842003.588314:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788842003.588338:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b778a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500710784:0@lo:400:kworker.0 00000100:00100000:2.0:1788842003.588361:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500710912 00000100:00100000:2.0:1788842003.588364:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500710912 00000100:00100000:2.0:1788842003.588416:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788842003.588424:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875736500710912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788842003.588471:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875736500710912:12345-0@lo:400:kworker.0 Request processed in 48us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842003.588477:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788842003.588510:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875736500710912:0@lo:400:kworker.0 00000100:00080000:0.0:1788842003.588757:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788842003.589058:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500710400 00000100:00100000:3.0:1788842003.589069:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500710400 00000100:00100000:3.0:1788842003.589171:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1788842003.589181:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49926050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3310:x1875736500710400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788842003.589255:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49926050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3310:x1875736500710400:12345-0@lo:400:kworker.0 Request processed in 75us (1292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842003.589262:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788842003.589340:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b77aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500710400:0@lo:400:kworker.0 00000100:00100000:0.0:1788842003.622147:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842003.622249:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489174400 00000100:00100000:3.0:1788842003.622267:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489174400 00000100:00100000:3.0:1788842003.622371:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 163 00000100:00100000:3.0:1788842003.622388:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b77aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+51:11492:x1875736489174400:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1788842003.622438:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842003.622472:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bc17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2397 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788842003.622646:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788842003.623167:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bc17 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2397 expref: 53 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.623195:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a821d0300) 00010000:00010000:3.0:1788842003.623198:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788842003.623262:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bc17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2397 expref: 53 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.623336:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60052400, rc 0) 00000100:00100000:3.0:1788842003.623417:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b77aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+52:11492:x1875736489174400:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 1034us (1279us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1788842003.623435:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 163 00000100:00100000:0.0:1788842003.634322:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842003.635112:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489174528 00000100:00100000:2.0:1788842003.635124:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489174528 00000100:00100000:2.0:1788842003.635208:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 164 00000100:00100000:2.0:1788842003.635220:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+52:11492:x1875736489174528:12345-192.168.204.55@tcp:34:lfs.0 00010000:00010000:2.0:1788842003.635308:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8bc25 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.635326:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8bc25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.635337:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8bc25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.635352:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.635359:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.635367:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.635470:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8bc33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.635479:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8bc33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.635486:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8bc33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788842003.635556:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8bc33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.635569:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8bc25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.635576:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8bc25 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.635583:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8bc25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.635589:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cca00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842003.635593:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8bc25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.635600:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8bc25 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.635613:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:2.0:1788842003.635615:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842003.635620:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8bc25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.635625:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8bc25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.636467:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.636476:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.636493:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.636498:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842003.636702:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.637183:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.637198:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3a61283200) 00010000:00010000:2.0:1788842003.637200:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842003.637205:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc2c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.637211:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.637229:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8bc33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.637235:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8bc33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.637242:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8bc33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.637248:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd000 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842003.637251:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8bc33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.637270:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8bc33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.637278:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a821d0c00) 00010000:00010000:2.0:1788842003.637280:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842003.637284:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8bc33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.637289:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8bc33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842003.640175:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+52:11492:x1875736489174528:12345-192.168.204.55@tcp:34:lfs.0 Request processed in 4950us (5856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842003.640190:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 164 00000100:00100000:0.0:1788842003.647590:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842003.647645:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489174784 00000100:00100000:3.0:1788842003.647656:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489174784 00000100:00100000:3.0:1788842003.647745:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 46 00000100:00100000:3.0:1788842003.647757:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+52:11492:x1875736489174784:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:3.0:1788842003.648079:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+53:11492:x1875736489174784:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 323us (662us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788842003.648087:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 46 00000100:00100000:0.0:1788842003.681027:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842003.681180:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489175040 00000100:00100000:2.0:1788842003.681194:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489175040 00000100:00100000:2.0:1788842003.681383:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 165 00000100:00100000:2.0:1788842003.681398:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+53:11495:x1875736489175040:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1788842003.681434:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842003.681464:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8bc3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef239e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.681590:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc41 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.681609:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.681623:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.681674:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8bc48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.681684:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8bc48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.681691:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8bc48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.681941:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bc4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.681952:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bc4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.681960:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bc4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788842003.681973:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788842003.682145:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.682153:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc41 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.682160:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.682167:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842003.682172:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.682190:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc41 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.682205:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:2.0:1788842003.682208:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842003.682213:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.682219:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.682236:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8bc48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.682242:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8bc48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.682249:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8bc48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.682254:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cca00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842003.682257:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8bc48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.682264:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8bc48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.682271:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3a61283200) 00010000:00010000:2.0:1788842003.682274:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842003.682277:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8bc48 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.682409:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8bc48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.682467:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8bc3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef239e expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.682484:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bc4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef239e expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.682491:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a821d0c00) 00010000:00010000:2.0:1788842003.682494:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788842003.682497:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cdc00, rc 0) 00000100:00100000:2.0:1788842003.682631:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+55:11495:x1875736489175040:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 1236us (1632us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788842003.682641:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 165 00000100:00100000:0.0:1788842003.685635:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842003.685837:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842003.685922:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489175296 00000100:00100000:3.0:1788842003.685937:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489175296 00000100:00100000:3.0:1788842003.686020:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 166 00000100:00100000:3.0:1788842003.686034:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+55:11495:x1875736489175296:12345-192.168.204.55@tcp:54:lfs.0 00010000:00010000:3.0:1788842003.686124:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bc5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.686161:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bc5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.686175:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bc5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.686211:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bc5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.686219:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bc5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.686227:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bc5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.686234:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842003.686240:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bc5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.686249:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bc5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.686264:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a821d0c00) 00010000:00010000:3.0:1788842003.686268:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788842003.686273:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bc5d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842003.686279:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bc5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842003.686389:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+55:11495:x1875736489175296:12345-192.168.204.55@tcp:54:lfs.0 Request processed in 358us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842003.686403:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 166 00000100:00100000:1.0:1788842003.689402:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842003.689491:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489175552 00000100:00100000:0.0:1788842003.689503:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489175552 00000100:00100000:0.0:1788842003.689587:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 47 00000100:00100000:0.0:1788842003.689600:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+55:11495:x1875736489175552:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:0.0:1788842003.689957:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+56:11495:x1875736489175552:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 359us (569us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1788842003.689966:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 47 00000100:00100000:2.0:1788842003.690196:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489175168 00000100:00100000:2.0:1788842003.690203:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489175168 00000100:00100000:2.0:1788842003.690259:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:2.0:1788842003.690268:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+56:2349:x1875736489175168:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788842003.690282:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788842003.690313:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bc4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef239e expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.690341:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a821d0c00) 00010000:00010000:2.0:1788842003.690348:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788842003.690385:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+55:2349:x1875736489175168:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 119us (4765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842003.690403:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:1.0:1788842003.802094:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842003.802233:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489175808 00000100:00100000:2.0:1788842003.802245:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489175808 00000100:00100000:2.0:1788842003.802445:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 167 00000100:00100000:2.0:1788842003.802457:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+55:11513:x1875736489175808:12345-192.168.204.55@tcp:101:cat.0 00010000:00010000:2.0:1788842003.802482:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842003.802504:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bc64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef23a5 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.802605:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8bc6b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.802621:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8bc6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.802633:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8bc6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788842003.802645:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788842003.802829:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bc64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23a5 expref: 58 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.802849:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8bc6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23a5 expref: 57 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.802869:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a821d0c00) 00010000:00010000:2.0:1788842003.802872:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788842003.802876:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cd000, rc 0) 00000100:00100000:2.0:1788842003.802959:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+57:11513:x1875736489175808:12345-192.168.204.55@tcp:101:cat.0 Request processed in 504us (875us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788842003.802966:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 167 00000100:00100000:1.0:1788842003.861485:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842003.861918:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489175936 00000100:00100000:2.0:1788842003.861938:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489175936 00000100:00100000:2.0:1788842003.862033:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 168 00000100:00100000:2.0:1788842003.862046:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+57:11514:x1875736489175936:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1788842003.862078:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842003.862106:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bc79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef23ac expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.862200:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8bc80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.862218:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8bc80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.862234:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8bc80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788842003.862295:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788842003.862299:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788842003.862323:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8bc80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.862370:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bc79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23ac expref: 59 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.862392:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8bc80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23ac expref: 58 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.862425:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:2.0:1788842003.862429:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788842003.862434:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cca00, rc 0) 00000100:00100000:2.0:1788842003.862514:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+58:11514:x1875736489175936:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 470us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842003.862949:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 168 00000100:00100000:1.0:1788842003.868868:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842003.869076:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489176320 00000100:00100000:0.0:1788842003.869090:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489176320 00000100:00100000:0.0:1788842003.869170:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 48 00000100:00100000:0.0:1788842003.869183:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+58:11514:x1875736489176320:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:0.0:1788842003.869635:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+59:11514:x1875736489176320:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 453us (781us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788842003.869645:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 48 00000100:00100000:1.0:1788842003.872545:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842003.872774:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489176448 00000100:00100000:2.0:1788842003.872799:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489176448 00000100:00100000:2.0:1788842003.872901:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 14 00000100:00100000:2.0:1788842003.872915:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4ec1a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+59:11514:x1875736489176448:12345-192.168.204.55@tcp:103:lfs.0 00010000:00010000:2.0:1788842003.872938:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788842003.872973:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8bc10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2390 expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.873019:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8bc6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23a5 expref: 58 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.873035:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530800/0x3de1064d33a8bb1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2351 expref: 57 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.873047:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a821d0c00) 00010000:00010000:2.0:1788842003.873061:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788842003.873178:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4ec1a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+56:11514:x1875736489176448:12345-192.168.204.55@tcp:103:lfs.0 Request processed in 266us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842003.873187:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 14 00000100:00100000:1.0:1788842003.876545:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842003.876688:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489176576 00000100:00100000:0.0:1788842003.876703:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489176576 00000100:00100000:0.0:1788842003.876863:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 169 00000100:00100000:0.0:1788842003.876877:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+56:11514:x1875736489176576:12345-192.168.204.55@tcp:58:lfs.0 00010000:00010000:0.0:1788842003.877180:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bc87 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.877202:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bc87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842003.877217:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bc87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788842003.877642:0:8623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788842003.877826:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+56:11514:x1875736489176576:12345-192.168.204.55@tcp:58:lfs.0 Request processed in 947us (1291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842003.877836:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 169 00000100:00100000:1.0:1788842003.900639:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842003.900903:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489176704 00000100:00100000:2.0:1788842003.900918:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489176704 00000100:00100000:2.0:1788842003.901016:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 170 00000100:00100000:2.0:1788842003.901029:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+56:11516:x1875736489176704:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1788842003.901056:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842003.901179:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8bc8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef23b3 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.901301:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bc95 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.901320:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bc95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.901334:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bc95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.901352:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.901360:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.901367:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.901485:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8bca3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.901495:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8bca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.902217:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8bca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788842003.902269:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788842003.902275:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788842003.902301:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8bca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.902317:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8bca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.902327:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bc95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.902335:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bc95 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.902342:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bc95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.902349:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cdc00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842003.902354:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bc95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.902362:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bc95 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.902377:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:2.0:1788842003.902381:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842003.902387:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bc95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.902405:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bc95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.902424:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.902430:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.902437:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.902442:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842003.902445:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.902451:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.902459:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3a61283200) 00010000:00010000:2.0:1788842003.902462:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842003.902465:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.902471:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bc9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.903306:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8bc8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23b3 expref: 58 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.903330:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8bca3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23b3 expref: 57 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842003.903350:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a4e719900) 00010000:00010000:2.0:1788842003.903353:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788842003.903357:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cd800, rc 0) 00000100:00100000:2.0:1788842003.903452:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+57:11516:x1875736489176704:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 2425us (2826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842003.903462:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 170 00000004:00080000:0.0:1788842004.108528:0:7986:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 332265815157ns, next at 333265811889ns, rc = 0 00000100:00100000:3.0:1788842004.108828:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788842004.108858:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500711168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788842004.108949:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842004.109054:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500711168 00000100:00100000:3.0:1788842004.109063:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500711168 00000100:00100000:3.0:1788842004.109121:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788842004.109132:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875736500711168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788842004.109615:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788842004.109774:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875736500711168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 643us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842004.109783:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788842004.109853:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500711168:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788842004.174756:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:2.0:1788842004.174772:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:0.0:1788842004.355132:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788842004.546024:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788842004.546032:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788842004.546071:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788842004.546079:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788842004.546198:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a767cc700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11681:1875736500711296:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788842004.546298:0:11681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a429d8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788842004.555785:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842004.555832:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489176832 00000100:00100000:1.0:1788842004.555842:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489176832 00000100:00100000:1.0:1788842004.555899:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 171 00000100:00100000:1.0:1788842004.555908:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+58:11527:x1875736489176832:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788842004.555938:0:5850:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788842004.556053:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+58:11527:x1875736489176832:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 Request processed in 145us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842004.556061:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 171 00000100:00100000:3.0:1788842004.558920:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a767cc700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11681:1875736500711296:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788842004.559262:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842004.559811:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489176960 00000100:00100000:3.0:1788842004.559821:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489176960 00000100:00100000:3.0:1788842004.559877:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 172 00000100:00100000:3.0:1788842004.559887:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+57:11527:x1875736489176960:12345-192.168.204.55@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788842004.559957:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bcaa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.559975:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bcaa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.559986:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bcaa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.560029:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bcb1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.560037:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bcb1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.560044:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bcb1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.560073:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bcb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.560081:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bcb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.560087:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bcb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788842004.560123:0:8623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788842004.560128:0:8623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788842004.560141:0:8623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bcb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.560152:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bcaa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.560158:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bcaa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.560165:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bcaa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.560182:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842004.560186:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bcaa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.560194:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bcaa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.560208:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d3a428df000) 00010000:00010000:3.0:1788842004.560211:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788842004.560216:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bcaa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.560222:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bcaa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.560237:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bcb1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.560243:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bcb1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.560249:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bcb1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.560254:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842004.560257:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bcb1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.560263:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bcb1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.560283:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8d3a821d0200) 00010000:00010000:3.0:1788842004.560285:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788842004.560288:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bcb1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.560294:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bcb1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.560314:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bcb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.560320:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bcb8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.560325:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bcb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.560330:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052a00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842004.560333:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bcb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.560339:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bcb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.561470:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a4e719900) 00010000:00010000:3.0:1788842004.561474:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788842004.561480:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bcb8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.561488:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bcb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842004.561594:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+57:11527:x1875736489176960:12345-192.168.204.55@tcp:34:lhsmtool_posix.0 Request processed in 1703us (2329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842004.561605:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 172 00000100:00100000:3.0:1788842004.567324:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842004.567477:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489177216 00000100:00100000:2.0:1788842004.567490:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489177216 00000100:00100000:2.0:1788842004.567560:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 173 00000100:00100000:2.0:1788842004.567570:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+57:11527:x1875736489177216:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788842004.567591:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842004.567613:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bcbf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef23ba expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842004.567753:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bcc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842004.567768:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bcc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842004.567780:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bcc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788842004.567792:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788842004.568088:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bcc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842004.568105:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bcc6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842004.568112:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bcc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842004.568118:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cdc00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842004.568122:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bcc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842004.568129:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bcc6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842004.568142:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a4e719900) 00010000:00010000:2.0:1788842004.568144:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788842004.568149:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bcc6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842004.568154:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bcc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842004.568196:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bcbf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23ba expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842004.568206:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d3a428df000) 00010000:00010000:2.0:1788842004.568209:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788842004.568213:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bcbf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23ba expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842004.568223:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cd200, rc 0) 00000100:00100000:2.0:1788842004.568339:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+58:11527:x1875736489177216:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 769us (1030us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1788842004.568356:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 173 00000100:00100000:0.0:1788842004.598244:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842004.598389:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489177344 00000100:00100000:1.0:1788842004.598401:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489177344 00000100:00100000:1.0:1788842004.598470:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 174 00000100:00100000:1.0:1788842004.598481:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+58:11527:x1875736489177344:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788842004.598520:0:6963:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788842004.598640:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+58:11527:x1875736489177344:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 Request processed in 160us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842004.598666:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 174 00000100:00100000:0.0:1788842004.607056:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842004.607140:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489177600 00000100:00100000:3.0:1788842004.607159:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489177600 00000100:00100000:3.0:1788842004.607247:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 175 00000100:00100000:3.0:1788842004.607261:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+58:11527:x1875736489177600:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788842004.607296:0:8623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842004.607302:0:8623:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788842004.607342:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8bc80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23ac expref: 58 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.607367:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:3.0:1788842004.607374:0:8623:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788842004.607392:0:8623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bcd4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef23c1 expref: -99 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788842004.610542:0:8623:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788842004.611004:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bcdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.611028:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bcdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.611042:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bcdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.611165:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bcd4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23c1 expref: 60 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.611188:0:8623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bcdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23c1 expref: 59 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.611199:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d3a821d0200) 00010000:00010000:3.0:1788842004.611203:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788842004.611207:0:8623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60053800, rc 0) 00000100:00100000:3.0:1788842004.611309:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+59:11527:x1875736489177600:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 4051us (4267us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788842004.611319:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 175 00000100:00100000:3.0:1788842004.621036:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842004.621093:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489177856 00000100:00100000:3.0:1788842004.621104:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489177856 00000100:00100000:3.0:1788842004.621171:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 176 00000100:00100000:3.0:1788842004.621183:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+59:11527:x1875736489177856:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788842004.621259:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788842004.621292:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bcdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23c1 expref: 59 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.621320:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d3a821d0200) 00010000:00010000:3.0:1788842004.621333:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788842004.621364:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bce9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.621401:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bce9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.621412:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bce9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.621430:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bcf0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x79359db6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.621438:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bcf0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x79359db6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.621444:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bcf0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x79359db6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.621538:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bce9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.621546:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bce9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.621553:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bce9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.621559:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842004.621564:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bce9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.621572:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bce9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.621582:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:3.0:1788842004.621591:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788842004.621596:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bce9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.621604:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bce9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.621615:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bcf0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x79359db6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.621620:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bcf0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x79359db6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.621626:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bcf0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x79359db6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.621630:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053e00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842004.621633:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bcf0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x79359db6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.621638:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bcf0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x79359db6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.621645:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x79359db6 (ffff8d3a821d0000) 00010000:00010000:3.0:1788842004.621648:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788842004.621651:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bcf0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x79359db6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.621656:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bcf0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x79359db6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842004.621792:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+58:11527:x1875736489177856:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 610us (770us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788842004.621810:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 176 00000100:00100000:3.0:1788842004.642802:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842004.642878:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489177984 00000100:00100000:3.0:1788842004.642891:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489177984 00000100:00100000:3.0:1788842004.642971:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 177 00000100:00100000:3.0:1788842004.642984:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+58:11527:x1875736489177984:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788842004.643026:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842004.643058:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bcf7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef23c8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.643111:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8bcfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.643128:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8bcfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.643142:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8bcfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.643602:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bcf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23c8 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.643624:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8bcfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23c8 expref: 59 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.643634:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d3a821d0a00) 00010000:00010000:3.0:1788842004.643637:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788842004.643641:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40031000, rc 0) 00000100:00100000:3.0:1788842004.643751:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+59:11527:x1875736489177984:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 769us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842004.643760:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 177 00000100:00100000:3.0:1788842004.651105:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842004.651299:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489178240 00000100:00100000:0.0:1788842004.651314:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489178240 00000100:00100000:0.0:1788842004.651386:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 178 00000100:00100000:0.0:1788842004.651397:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+59:11527:x1875736489178240:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788842004.651482:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bd05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842004.651499:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bd05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842004.651511:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bd05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788842004.651931:0:8623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1788842004.651943:0:8623:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 332809232890ns, next at 333809229718ns, rc = 0 00000004:00010000:0.0:1788842004.652043:0:8623:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006105366 reply state 000000006ed210bb transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bd05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842004.652073:0:8623:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788842004.652189:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+61:11527:x1875736489178240:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 794us (1100us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1788842004.652196:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 178 00010000:00010000:0.0:1788842004.661434:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bd05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842004.661455:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bd05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842004.661464:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bd05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842004.661471:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f000 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842004.661477:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bd05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842004.661486:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bd05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842004.661505:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d3a821d0a00) 00010000:00010000:0.0:1788842004.661509:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788842004.661514:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bd05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842004.661521:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bd05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842004.663426:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842004.663549:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489178368 00000100:00100000:2.0:1788842004.663568:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489178368 00000100:00100000:2.0:1788842004.663661:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 179 00000100:00100000:2.0:1788842004.663675:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+60:11527:x1875736489178368:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788842004.663881:0:6963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842004.663908:0:6963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bd0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef23cf expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842004.664207:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bd0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23cf expref: 61 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842004.664225:0:6963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bd0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23cf expref: 61 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842004.664252:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d3a821d0a00) 00010000:00010000:2.0:1788842004.664256:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788842004.664262:0:6963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cd200, rc 0) 00000100:00100000:2.0:1788842004.664347:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+61:11527:x1875736489178368:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 675us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842004.664355:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 179 00000100:00100000:3.0:1788842004.681181:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842004.681225:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489178496 00000100:00100000:3.0:1788842004.681237:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489178496 00000100:00100000:3.0:1788842004.681307:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 50 00000100:00100000:3.0:1788842004.681318:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2349:x1875736489178496:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788842004.684090:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2349:x1875736489178496:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 Request processed in 2761us (2910us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788842004.684106:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 50 00000100:00080000:3.0:1788842004.684151:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788842004.688215:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842004.688287:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489178752 00000100:00100000:0.0:1788842004.688322:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489178752 00000100:00100000:0.0:1788842004.688398:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 49 00000100:00100000:0.0:1788842004.688410:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+61:11527:x1875736489178752:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788842004.692688:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+62:11527:x1875736489178752:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 4262us (4464us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1788842004.692726:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 49 00000100:00100000:3.0:1788842004.715568:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842004.715679:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489179008 00000100:00100000:1.0:1788842004.715697:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489179008 00000100:00100000:1.0:1788842004.715794:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 180 00000100:00100000:1.0:1788842004.715807:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+62:11527:x1875736489179008:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788842004.716092:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+62:11527:x1875736489179008:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 286us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842004.716101:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 180 00000100:00100000:0.0:1788842004.742797:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842004.742938:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489179136 00000100:00100000:3.0:1788842004.742956:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489179136 00000100:00100000:3.0:1788842004.743046:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 181 00000100:00100000:3.0:1788842004.743057:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a767cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+62:11527:x1875736489179136:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788842004.743078:0:8623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842004.743101:0:8623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bd13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef23d6 expref: -99 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.743175:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.743191:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.743218:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788842004.743257:0:8623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788842004.743292:0:8623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.743322:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bd13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23d6 expref: 64 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.743343:0:8623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23d6 expref: 63 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.743353:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d3a821d0a00) 00010000:00010000:3.0:1788842004.743357:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788842004.743360:0:8623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60053e00, rc 0) 00000100:00100000:3.0:1788842004.743434:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a767cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+63:11527:x1875736489179136:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 379us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842004.743442:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 181 00000100:00100000:2.0:1788842004.755090:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842004.755291:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489179264 00000100:00100000:0.0:1788842004.755307:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489179264 00000100:00100000:0.0:1788842004.755382:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 51 00000100:00100000:0.0:1788842004.755393:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2351:x1875736489179264:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788842004.755416:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842004.755442:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004965dfb/0x3de1064d33a8bd21 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef23dd expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788842004.755474:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f9013, blocks: 0x1 00010000:00010000:0.0:1788842004.755499:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=332s v=(0 0) 00010000:00010000:0.0:1788842004.755504:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842004.755515:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004965dfb/0x3de1064d33a8bd21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23dd expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842004.755535:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000004965dfb/0x3de1064d33a8bd21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23dd expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842004.755550:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78e600, rc 0) 00000100:00100000:0.0:1788842004.755799:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:2351:x1875736489179264:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 407us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842004.755808:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 51 00000100:00100000:1.0:1788842004.777355:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842004.777442:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489179520 00000100:00100000:0.0:1788842004.777471:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489179520 00000100:00100000:0.0:1788842004.777548:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 182 00000100:00100000:0.0:1788842004.777559:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+63:11527:x1875736489179520:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788842004.777949:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+63:11527:x1875736489179520:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 390us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842004.777958:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 182 00000100:00100000:1.0:1788842004.803157:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842004.805154:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489179648 00000100:00100000:3.0:1788842004.805175:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489179648 00000100:00100000:3.0:1788842004.805268:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 52 00000100:00100000:3.0:1788842004.805282:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:11527:x1875736489179648:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788842004.805305:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842004.805330:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009331d965/0x3de1064d33a8bd28 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef23e4 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.805390:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000004965dfb/0x3de1064d33a8bd21 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23dd expref: 9 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.805401:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788842004.805406:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788842004.805412:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009331d965/0x3de1064d33a8bd28 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23e4 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.805461:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000004965dfb/0x3de1064d33a8bd21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23dd expref: 9 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.805477:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000004965dfb/0x3de1064d33a8bd21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23dd expref: 9 pid: 6695 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842004.805495:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6696:1875736500711424:192.168.204.55@tcp:104: 00000100:00100000:3.0:1788842004.805633:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7bc08540 going to sleep for 11 seconds 00000100:00100000:1.0:1788842004.810323:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6696:1875736500711424:192.168.204.55@tcp:104: 00010000:00010000:1.0:1788842004.810389:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009331d965/0x3de1064d33a8bd28 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23e4 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842004.810418:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60052800, rc 0) 00000100:00100000:1.0:1788842004.810495:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:11527:x1875736489179648:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 5216us (7347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842004.810506:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 52 00000100:00100000:0.0:1788842004.813984:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842004.814090:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489179776 00000100:00100000:3.0:1788842004.814103:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489179776 00010000:00010000:3.0:1788842004.814157:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000004965dfb/0x3de1064d33a8bd21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23dd expref: 9 pid: 6695 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842004.814204:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 69 00000100:00100000:3.0:1788842004.814215:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76808000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:2350:x1875736489179776:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788842004.814236:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788842004.814282:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000004965dfb/0x3de1064d33a8bd21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23dd expref: 9 pid: 6695 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.814298:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000004965dfb/0x3de1064d33a8bd21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23dd expref: 9 pid: 6695 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.814327:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004965dfb/0x3de1064d33a8bd21 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23dd expref: 9 pid: 6695 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.814348:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788842004.814353:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788842004.814363:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009331d965/0x3de1064d33a8bd28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23e4 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.814376:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009331d965/0x3de1064d33a8bd28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23e4 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842004.814424:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009331d965/0x3de1064d33a8bd28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23e4 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842004.814441:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5837:1875736500711552:192.168.204.55@tcp:105: 00000100:00100000:3.0:1788842004.814558:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a412ed900 going to sleep for 11 seconds 00000100:00100000:3.0:1788842004.832109:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5837:1875736500711552:192.168.204.55@tcp:105: 00010000:00010000:3.0:1788842004.832148:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788842004.832235:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76808000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:2350:x1875736489179776:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 18020us (18264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842004.832262:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 69 00000100:00100000:3.0:1788842004.837566:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842004.837614:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489179904 00000100:00100000:3.0:1788842004.837626:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489179904 00002000:00100000:3.0:1788842004.837689:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8d3a7616c000 x1875736489179904/t0(0) o4->090c7b3c-cdb1-4c0e-9553-671552ee3fa2@192.168.204.55@tcp:130/0 lens 504/0 e 0 to 0 dl 1788842015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788842004.837703:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3a7616c000 with x1875736489179904 ext(0->8) 00002000:00010000:3.0:1788842004.837727:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d3a7616c000 00000100:00100000:3.0:1788842004.838891:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 4 00000100:00100000:3.0:1788842004.838911:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:2350:x1875736489179904:12345-192.168.204.55@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788842004.840541:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+10:2350:x1875736489179904:12345-192.168.204.55@tcp:4:lhsmtool_posix.0 Request processed in 1623us (2980us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788842004.840560:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 4 00002000:00100000:3.0:1788842004.840576:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8d3a7616c000 x1875736489179904/t4294967314(0) o4->090c7b3c-cdb1-4c0e-9553-671552ee3fa2@192.168.204.55@tcp:130/0 lens 504/448 e 0 to 0 dl 1788842015 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788842004.840589:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3a7616c000 with x1875736489179904 ext(0->8) 00002000:00010000:3.0:1788842004.840598:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d3a7616c000 00000100:00100000:1.0:1788842004.865182:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842004.866407:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489180032 00000100:00100000:3.0:1788842004.866430:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489180032 00000100:00100000:3.0:1788842004.866532:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 183 00000100:00100000:3.0:1788842004.866546:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+63:11527:x1875736489180032:12345-192.168.204.55@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788842004.946089:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+63:11527:x1875736489180032:12345-192.168.204.55@tcp:44:lhsmtool_posix.0 Request processed in 79529us (80903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842004.946121:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 183 00000001:00080000:3.0:1788842004.946175:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1788842004.946188:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:3.0:1788842004.946202:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:3.0:1788842004.946236:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788842004.946248:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d3a47a7a9c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788842004.946252:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d3a4e715f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d3a47a7a300 00000020:00080000:3.0:1788842004.946256:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d3a4e715e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d3a486f8400 00000020:00080000:3.0:1788842004.947521:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788842004.947999:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788842004.948027:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500711680:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788842004.948182:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842004.948491:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500711680 00000100:00100000:1.0:1788842004.948501:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500711680 00000100:00100000:1.0:1788842004.948579:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788842004.948614:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7681a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500711680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788842004.948859:0:8622:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788842004.948863:0:8622:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788842003 00002000:00010000:1.0:1788842004.948866:0:8622:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788842004.948867:0:8622:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788842003 -> 1788842003 00002000:00010000:1.0:1788842004.948870:0:8622:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788842004.948923:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7681a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1875736500711680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 312us (740us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788842004.948930:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:3.0:1788842004.949924:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d3a7616c700/2, rc 0, transno 4294967315 00000100:00100000:3.0:1788842004.949938:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500711680:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788842004.949956:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788842004.949967:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500711808:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788842004.950032:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842004.950274:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500711808 00000100:00100000:1.0:1788842004.950282:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500711808 00000100:00100000:1.0:1788842004.950334:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788842004.950346:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7681b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500711808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788842004.950375:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1788842004.950418:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f9010, atime: 0x6a9f9011, ctime: 0x6a9f9010, blocks: 0xb 00010000:00010000:1.0:1788842004.950426:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cadf36d0/0x3de1064d33a8bd2f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842004.950446:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=333s v=(0 0) 00010000:00010000:1.0:1788842004.950452:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842004.950459:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cadf36d0/0x3de1064d33a8bd2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842004.950479:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cadf36d0/0x3de1064d33a8bd2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842004.950489:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cadf36d0/0x3de1064d33a8bd2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842004.950512:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cadf36d0/0x3de1064d33a8bd2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842004.950536:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788842004.958374:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842004.958561:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489180160 00000100:00100000:3.0:1788842004.958575:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489180160 00000100:00100000:3.0:1788842004.958740:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 55 00000100:00100000:3.0:1788842004.958756:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+10:2349:x1875736489180160:12345-192.168.204.55@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1788842004.960011:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788842004.960028:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cadf36d0/0x3de1064d33a8bd2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842004.960045:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24e200 already unused, calling callback (ffffffffc1813420) 00010000:00010000:0.0:1788842004.960052:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cadf36d0/0x3de1064d33a8bd2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842004.960075:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cadf36d0/0x3de1064d33a8bd2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842004.960103:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cadf36d0/0x3de1064d33a8bd2f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842004.960112:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cadf36d0/0x3de1064d33a8bd2f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842004.960140:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842004.960142:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842004.960151:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788842004.963763:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7681b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875736500711808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13403us (13714us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788842004.963785:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788842004.964928:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1788842004.964941:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1788842004.964976:0:3309:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8d3a7616d180 x1875736500711808/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788842020 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788842004.965034:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d3a7616d180/2, rc 0, transno 4294967307 00000100:00100000:3.0:1788842004.965041:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500711808:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1788842005.019817:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:1.0:1788842005.019845:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:3.0:1788842005.020106:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2349:x1875736489180160:12345-192.168.204.55@tcp:16:lhsmtool_posix.0 Request processed in 61347us (61741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842005.020122:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 55 00000100:00100000:3.0:1788842005.023797:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842005.023856:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489180416 00000100:00100000:3.0:1788842005.023869:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489180416 00000100:00100000:3.0:1788842005.023957:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 184 00000100:00100000:3.0:1788842005.023969:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+18:11527:x1875736489180416:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788842005.025504:0:6963:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788842005.025558:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23d6 expref: 18 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.025584:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d3a821d0a00) 00010000:00010000:3.0:1788842005.025589:0:6963:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788842005.026186:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bd36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.026209:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bd36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.026220:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bd36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788842005.026780:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:3.0:1788842005.027013:0:6963:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000515fe637 reply state 00000000309a42c1 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bd36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842005.027045:0:6963:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788842005.027520:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+19:11527:x1875736489180416:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 3546us (3730us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788842005.027543:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 184 00000100:00100000:1.0:1788842005.051100:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00010000:00010000:1.0:1788842005.051154:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bd36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842005.051170:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bd36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842005.051178:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bd36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842005.051185:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788842005.051191:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bd36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842005.051201:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bd36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842005.051225:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d3a821d0a00) 00010000:00010000:1.0:1788842005.051228:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788842005.051248:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bd36 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842005.051318:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bd36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842005.051366:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489180544 00000100:00100000:1.0:1788842005.051380:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489180544 00000100:00100000:1.0:1788842005.051452:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 56 00000100:00100000:1.0:1788842005.051464:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2350:x1875736489180544:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788842005.052928:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788842005.052940:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788842003 -> 1788842002 00002000:00010000:1.0:1788842005.052944:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788842001 00002000:00010000:1.0:1788842005.052946:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788842003 -> 1788842002 00002000:00010000:1.0:1788842005.052948:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788842005.053060:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:2350:x1875736489180544:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 Request processed in 1590us (1968us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788842005.053074:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 56 00000040:00080000:0.0:1788842005.056230:0:12448:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788842005.056244:0:12448:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788842005.056309:0:12448:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788842005.056317:0:12448:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788842005.062468:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842005.063518:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489180800 00000100:00100000:3.0:1788842005.063534:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489180800 00000100:00100000:3.0:1788842005.063610:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 185 00000100:00100000:3.0:1788842005.063622:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+18:11527:x1875736489180800:12345-192.168.204.55@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788842005.064000:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd3d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.064023:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8bcfe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23c8 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.064034:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd3d lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.064081:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8bcfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23c8 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.064098:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8bcfe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23c8 expref: 18 pid: 5851 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842005.064114:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875736500711936:192.168.204.55@tcp:104: 00000100:00100000:3.0:1788842005.064247:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a411ca900 going to sleep for 11 seconds 00000100:00100000:1.0:1788842005.073242:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842005.073293:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489180928 00000100:00100000:1.0:1788842005.073305:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489180928 00010000:00010000:1.0:1788842005.073357:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8bcfe lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23c8 expref: 19 pid: 5851 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842005.073404:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 70 00000100:00100000:1.0:1788842005.073415:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+19:2350:x1875736489180928:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788842005.073434:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788842005.073442:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8bcfe lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23c8 expref: 19 pid: 5851 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842005.073468:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8bcfe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23c8 expref: 19 pid: 5851 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842005.073494:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d3a821d0a00) 00010000:00010000:1.0:1788842005.073501:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd3d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842005.073514:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842005.073534:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd3d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842005.073558:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788842005.073624:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+19:2350:x1875736489180928:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 210us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842005.073643:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 70 00010000:00010000:0.0:1788842005.073953:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8bcfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23c8 expref: 18 pid: 5851 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842005.073973:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875736500711936:192.168.204.55@tcp:104: 00010000:00010000:0.0:1788842005.074008:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842005.074018:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842005.074025:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842005.074065:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842005.074073:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd3d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842005.074080:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842005.074086:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053e00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842005.074091:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842005.074112:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd3d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842005.074124:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d3a821d0a00) 00010000:00010000:0.0:1788842005.074127:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788842005.074132:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd3d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842005.074137:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd3d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842005.074197:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+17:11527:x1875736489180800:12345-192.168.204.55@tcp:55:lhsmtool_posix.0 Request processed in 10578us (11747us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788842005.074206:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 185 00000100:00100000:2.0:1788842005.078597:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842005.078811:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489181056 00000100:00100000:0.0:1788842005.078825:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489181056 00000100:00100000:0.0:1788842005.078897:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 57 00000100:00100000:0.0:1788842005.078909:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:2350:x1875736489181056:12345-192.168.204.55@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788842005.078971:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009919ea39/0x3de1064d33a8bd44 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842005.079007:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009331d965/0x3de1064d33a8bd28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23e4 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842005.079017:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788842005.079022:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788842005.079027:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009919ea39/0x3de1064d33a8bd44 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842005.079095:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009331d965/0x3de1064d33a8bd28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23e4 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842005.079111:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009331d965/0x3de1064d33a8bd28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23e4 expref: 8 pid: 6696 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842005.079129:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76213800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1875736500712064:192.168.204.55@tcp:104: 00000100:00100000:0.0:1788842005.079234:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4ea5a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788842005.085726:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76213800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1875736500712064:192.168.204.55@tcp:104: 00010000:00010000:3.0:1788842005.085787:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009919ea39/0x3de1064d33a8bd44 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842005.086606:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842005.087028:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489181184 00000100:00100000:3.0:1788842005.087040:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489181184 00010000:00010000:3.0:1788842005.087099:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009331d965/0x3de1064d33a8bd28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23e4 expref: 9 pid: 6696 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842005.087157:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 71 00000100:00100000:3.0:1788842005.087169:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:2350:x1875736489181184:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788842005.087190:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788842005.087224:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009331d965/0x3de1064d33a8bd28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23e4 expref: 9 pid: 6696 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.087240:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009331d965/0x3de1064d33a8bd28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23e4 expref: 9 pid: 6696 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.087282:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009331d965/0x3de1064d33a8bd28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23e4 expref: 9 pid: 6696 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.087305:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788842005.087311:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788842005.087319:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009919ea39/0x3de1064d33a8bd44 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.087352:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009919ea39/0x3de1064d33a8bd44 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.087383:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788842005.087451:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:2350:x1875736489181184:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 284us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842005.087459:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 71 00010000:00010000:3.0:1788842005.087500:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009919ea39/0x3de1064d33a8bd44 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.087511:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009919ea39/0x3de1064d33a8bd44 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.087554:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009919ea39/0x3de1064d33a8bd44 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.087564:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009919ea39/0x3de1064d33a8bd44 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.087572:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009919ea39/0x3de1064d33a8bd44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.087580:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78fe00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:3.0:1788842005.087585:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009919ea39/0x3de1064d33a8bd44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.087608:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009919ea39/0x3de1064d33a8bd44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.087621:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009919ea39/0x3de1064d33a8bd44 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.087628:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009919ea39/0x3de1064d33a8bd44 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842005.087833:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2350:x1875736489181056:12345-192.168.204.55@tcp:1:lhsmtool_posix.0 Request processed in 8926us (9250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842005.087844:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 57 00000100:00100000:2.0:1788842005.095093:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842005.095458:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489181440 00000100:00100000:3.0:1788842005.095475:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489181440 00000100:00100000:3.0:1788842005.095561:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 186 00000100:00100000:3.0:1788842005.095574:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+17:11527:x1875736489181440:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788842005.095704:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bd4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.095758:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bd4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.095772:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bd4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.096104:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bd52 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.096124:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bd0c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23cf expref: 18 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.096133:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bd52 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.096177:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bd0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23cf expref: 18 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.096194:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bd0c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23cf expref: 18 pid: 6963 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842005.096211:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875736500712192:192.168.204.55@tcp:104: 00000100:00100000:3.0:1788842005.096321:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a411ca9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788842005.099351:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875736500712192:192.168.204.55@tcp:104: 00010000:00010000:3.0:1788842005.099392:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bd52 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842005.127338:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842005.128057:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489181568 00000100:00100000:3.0:1788842005.128074:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489181568 00010000:00010000:3.0:1788842005.128137:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bd0c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23cf expref: 19 pid: 6963 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842005.128196:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 72 00000100:00100000:3.0:1788842005.128208:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c254a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+19:2349:x1875736489181568:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788842005.128226:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788842005.128254:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bd0c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23cf expref: 19 pid: 6963 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.128285:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bd0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23cf expref: 19 pid: 6963 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.128313:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bd0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23cf expref: 19 pid: 6963 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.128333:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d3a821d0a00) 00010000:00010000:3.0:1788842005.128340:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bd52 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.128352:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bd52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.128361:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bd52 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.128393:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788842005.128469:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c254a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+18:2349:x1875736489181568:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 263us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842005.128476:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 72 00010000:00010000:3.0:1788842005.128512:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bd52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.128774:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bd52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788842005.129032:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1788842005.129215:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1788842005.129291:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1788842005.129400:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1875736500712320:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788842005.129475:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842005.129519:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4144a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788842005.130952:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500712320 00000100:00100000:2.0:1788842005.130970:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500712320 00000100:00100000:2.0:1788842005.131074:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788842005.131087:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875736500712320:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788842005.131234:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875736500712320:12345-0@lo:1000:mdt00_002.0 Request processed in 149us (1758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842005.131242:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788842005.131269:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788842005.131495:0:5852:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1788842005.131501:0:5852:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d3a7616c700, transno 4294967315 00000100:00100000:3.0:1788842005.131727:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1875736500712320:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788842005.132372:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1788842005.132495:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1875736500712448:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788842005.133963:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842005.134039:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a411ca9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788842005.136475:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500712448 00000100:00100000:3.0:1788842005.136498:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500712448 00000100:00100000:3.0:1788842005.136608:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788842005.136622:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875736500712448:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788842005.137232:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5852:x1875736500712448:12345-0@lo:1000:mdt00_002.0 Request processed in 611us (3276us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788842005.137243:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788842005.137334:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1875736500712448:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788842005.137392:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bd52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.137405:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bd52 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.137413:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bd52 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.137434:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052a00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842005.137441:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bd52 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.137451:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bd52 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.137472:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d3a821d0a00) 00010000:00010000:3.0:1788842005.137476:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788842005.137482:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bd52 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.137488:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8bd52 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.138724:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bc87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.138743:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bc87 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.138752:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bc87 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.138758:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78fc00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842005.138763:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bc87 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.138770:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bc87 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.138801:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a4e719900) 00010000:00010000:3.0:1788842005.138805:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788842005.138811:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bc87 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.138817:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bc87 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.138859:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bd59 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.138878:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8bca3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23b3 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.138889:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bd59 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.138941:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8bca3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23b3 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.138959:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8bca3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23b3 expref: 21 pid: 5852 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842005.138977:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76865180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875736500712576:192.168.204.55@tcp:104: 00000100:00100000:3.0:1788842005.139115:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a6193a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788842005.159603:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842005.160187:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76865180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875736500712576:192.168.204.55@tcp:104: 00010000:00010000:2.0:1788842005.160226:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bd59 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842005.160592:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489181696 00000100:00100000:2.0:1788842005.160602:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489181696 00010000:00010000:2.0:1788842005.160727:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8bca3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23b3 expref: 22 pid: 5852 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842005.160774:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 73 00000100:00100000:2.0:1788842005.160786:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c257b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+22:2349:x1875736489181696:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788842005.160807:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788842005.160816:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8bca3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23b3 expref: 22 pid: 5852 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842005.160830:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8bca3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23b3 expref: 22 pid: 5852 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842005.160884:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd800/0x3de1064d33a8bca3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23b3 expref: 22 pid: 5852 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842005.160904:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a4e719900) 00010000:00010000:2.0:1788842005.160909:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bd59 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842005.160919:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bd59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842005.160929:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bd59 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842005.160957:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788842005.161033:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c257b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+21:2349:x1875736489181696:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 249us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842005.161042:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 73 00010000:00010000:2.0:1788842005.161078:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bd59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842005.161087:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bd59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842005.161100:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bd59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842005.161108:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bd59 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842005.161115:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bd59 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842005.161128:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842005.161134:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bd59 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842005.161143:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bd59 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842005.161153:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a4e719900) 00010000:00010000:2.0:1788842005.161156:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842005.161159:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bd59 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842005.161164:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bd59 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842005.161174:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bd4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842005.161180:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bd4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842005.161186:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bd4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842005.161191:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842005.161194:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bd4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842005.161201:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bd4b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842005.161221:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a4e719900) 00010000:00010000:2.0:1788842005.161223:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788842005.161227:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bd4b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842005.161232:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bd4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842005.166086:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+20:11527:x1875736489181440:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 70493us (70990us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1788842005.166106:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 186 00000020:00080000:2.0:1788842005.166114:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788842005.169300:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842005.169356:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489181952 00000100:00100000:3.0:1788842005.169368:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489181952 00000100:00100000:3.0:1788842005.169447:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 50 00000100:00100000:3.0:1788842005.169478:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a658dbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+20:11527:x1875736489181952:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000040:00080000:2.0:1788842005.170442:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788842005.170453:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000004:00080000:3.0:1788842005.171564:0:5854:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788842005.172207:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788842005.172222:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1788842005.174161:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1788842005.174868:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.174896:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.174910:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.174921:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd60 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.174928:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd60 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.174936:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.175017:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788842005.175167:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a658dbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+22:11527:x1875736489181952:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 5686us (5877us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788842005.175180:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 50 00000020:00080000:3.0:1788842005.175188:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788842005.180460:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788842005.180482:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd60 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842005.180497:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053e00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:0.0:1788842005.180502:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd60 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842005.180515:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842005.180548:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d3a42af4200) 00010000:00010000:0.0:1788842005.180552:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788842005.180558:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd60 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842005.180565:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bd60 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842005.181779:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842005.181785:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842005.181787:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842005.377999:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788842006.146533:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788842006.146578:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a47d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500712704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788842006.146682:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842006.147243:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500712704 00000100:00100000:1.0:1788842006.147256:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500712704 00000100:00100000:1.0:1788842006.147332:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788842006.147342:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875736500712704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788842006.147393:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788842006.147462:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875736500712704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842006.147470:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788842006.148643:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a47d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500712704:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788842006.402700:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788842006.440015:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842006.440070:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842006.440131:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842006.440219:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842006.440322:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489182464 00000100:00100000:1.0:1788842006.440343:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489182464 00000100:00100000:1.0:1788842006.440432:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489182336 00000100:00100000:1.0:1788842006.440436:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489182336 00000100:00100000:1.0:1788842006.440464:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 94 00000100:00100000:1.0:1788842006.440476:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76864000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2349:x1875736489182464:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788842006.440590:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76864000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2349:x1875736489182464:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 116us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842006.440598:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 94 00000100:00100000:1.0:1788842006.440621:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 95 00000100:00100000:1.0:1788842006.440628:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76864700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2349:x1875736489182336:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788842006.440659:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76864700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2349:x1875736489182336:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 31us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842006.440665:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 95 00000100:00080000:3.0:1788842006.440829:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788842006.440834:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788842006.440900:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489182080 00000100:00100000:0.0:1788842006.440906:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489182080 00000100:00100000:0.0:1788842006.440947:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 299 00000100:00100000:0.0:1788842006.440964:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2349:x1875736489182080:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788842006.441006:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2349:x1875736489182080:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 52us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842006.441014:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 299 00000100:00100000:2.0:1788842006.441542:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489182208 00000100:00100000:2.0:1788842006.441550:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489182208 00000100:00100000:2.0:1788842006.444640:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 162 00000100:00100000:2.0:1788842006.444675:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76865880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+22:2349:x1875736489182208:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788842006.444826:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76865880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+22:2349:x1875736489182208:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 168us (4824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842006.444834:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 162 00000100:00100000:3.0:1788842006.445452:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842006.454038:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489182592 00000100:00100000:1.0:1788842006.454063:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489182592 00000100:00100000:1.0:1788842006.454197:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 163 00000100:00100000:1.0:1788842006.454211:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2349:x1875736489182592:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788842006.454346:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2349:x1875736489182592:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 139us (8897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842006.454353:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 163 00000100:00080000:1.0:1788842006.454396:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788842007.169964:0:12500:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788842007.169980:0:12500:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788842007.170024:0:12500:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788842007.170033:0:12500:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788842007.337463:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842007.337697:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489182848 00000100:00100000:0.0:1788842007.337731:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489182848 00000100:00080000:3.0:1788842007.337821:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788842007.337828:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 187 00000100:00100000:0.0:1788842007.337842:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+22:11546:x1875736489182848:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1788842007.337868:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842007.337907:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bd67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef23eb expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.338069:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8bd6e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.338087:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8bd6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.338102:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8bd6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788842007.338129:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788842007.338289:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bd67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23eb expref: 25 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.338318:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8bd6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23eb expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.338329:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:0.0:1788842007.338332:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788842007.338336:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78e800, rc 0) 00000100:00100000:0.0:1788842007.338420:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+24:11546:x1875736489182848:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 581us (975us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1788842007.338429:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 187 00000100:00100000:3.0:1788842007.345406:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842007.346867:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489182976 00000100:00100000:0.0:1788842007.346903:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489182976 00000100:00100000:0.0:1788842007.347002:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 188 00000100:00100000:0.0:1788842007.347014:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+24:11546:x1875736489182976:12345-192.168.204.55@tcp:34:lfs.0 00010000:00010000:0.0:1788842007.347121:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8bd7c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347146:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8bd7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347164:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8bd7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347182:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8bd83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347204:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8bd83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347211:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8bd83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347523:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bd8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347531:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bd8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347540:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bd8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788842007.347594:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bd8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347610:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8bd7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347617:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8bd7c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347625:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8bd7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347632:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842007.347636:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8bd7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347645:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8bd7c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347666:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:0.0:1788842007.347669:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842007.347675:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8bd7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347682:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8bd7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347704:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8bd83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347735:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8bd83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347741:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8bd83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347747:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78fa00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842007.347750:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8bd83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347756:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8bd83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347764:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3a4e719700) 00010000:00010000:0.0:1788842007.347766:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842007.347769:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8bd83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347775:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8bd83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347802:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bd8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347809:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bd8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347815:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bd8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347820:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f600 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842007.347823:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bd8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347830:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bd8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347837:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a4e719400) 00010000:00010000:0.0:1788842007.347839:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842007.347842:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bd8a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.347849:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bd8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842007.347986:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+24:11546:x1875736489182976:12345-192.168.204.55@tcp:34:lfs.0 Request processed in 971us (2595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842007.347996:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 188 00000100:00100000:1.0:1788842007.404288:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842007.404386:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489183232 00000100:00100000:2.0:1788842007.404400:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489183232 00000100:00100000:2.0:1788842007.404490:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 189 00000100:00100000:2.0:1788842007.404503:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+24:11549:x1875736489183232:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1788842007.404530:0:8623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842007.404557:0:8623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bd91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef23f2 expref: -99 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.404662:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8bd98 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.404681:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8bd98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.404694:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8bd98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.404768:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bd9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.404776:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bd9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.404784:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bd9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.405136:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bda6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.405145:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bda6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.405152:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bda6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788842007.405175:0:8623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788842007.405303:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8bd98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.405312:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8bd98 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.405319:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8bd98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.405327:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cce00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842007.405332:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8bd98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.405341:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8bd98 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.405356:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:2.0:1788842007.405359:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842007.405364:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8bd98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.405372:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8bd98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.405387:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bd9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.405394:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bd9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.405411:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bd9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.405417:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842007.405420:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bd9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.405428:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bd9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.405436:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3a61283000) 00010000:00010000:2.0:1788842007.405439:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842007.405441:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bd9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.405447:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bd9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.405500:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bd91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23f2 expref: 27 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.405514:0:8623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bda6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23f2 expref: 26 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.405522:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a61283700) 00010000:00010000:2.0:1788842007.405524:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788842007.405527:0:8623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cd600, rc 0) 00000100:00100000:2.0:1788842007.405615:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+26:11549:x1875736489183232:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 1115us (1343us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788842007.405632:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 189 00000100:00100000:0.0:1788842007.425322:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842007.425380:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489183360 00000100:00100000:0.0:1788842007.425393:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489183360 00000100:00100000:0.0:1788842007.425464:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 190 00000100:00100000:0.0:1788842007.425477:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+26:11549:x1875736489183360:12345-192.168.204.55@tcp:54:lfs.0 00010000:00010000:0.0:1788842007.425570:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bdb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.425593:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bdb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.425606:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bdb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.425640:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bdb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.425647:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bdb4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.425653:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bdb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.425659:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f600 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842007.425664:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bdb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.425671:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bdb4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.425683:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a61283700) 00010000:00010000:0.0:1788842007.425686:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788842007.425691:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bdb4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.425730:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8bdb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842007.425821:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+26:11549:x1875736489183360:12345-192.168.204.55@tcp:54:lfs.0 Request processed in 345us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842007.429968:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 190 00010000:00010000:2.0:1788842007.431126:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788842007.447091:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842007.447624:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489183616 00000100:00100000:3.0:1788842007.447638:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489183616 00000100:00100000:3.0:1788842007.447730:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 51 00000100:00100000:3.0:1788842007.447744:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+26:11549:x1875736489183616:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:3.0:1788842007.448084:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+27:11549:x1875736489183616:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 342us (1008us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788842007.448094:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 51 00000100:00100000:0.0:1788842007.509400:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842007.510376:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489183872 00000100:00100000:1.0:1788842007.510391:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489183872 00000100:00100000:1.0:1788842007.511217:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 191 00000100:00100000:1.0:1788842007.511233:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+27:11075:x1875736489183872:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:1.0:1788842007.511275:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788842007.511301:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f000/0x3de1064d33a8bdbb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef23f9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.511414:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f600/0x3de1064d33a8bdc2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.511429:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bda6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23f2 expref: 28 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.511439:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f600/0x3de1064d33a8bdc2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.511844:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bda6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23f2 expref: 28 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.511873:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bda6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23f2 expref: 28 pid: 8623 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842007.511890:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a47d40a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875736500712832:192.168.204.55@tcp:104: 00000100:00100000:1.0:1788842007.512026:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d39456a4900 going to sleep for 11 seconds 00000100:00100000:0.0:1788842007.522114:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a47d40a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875736500712832:192.168.204.55@tcp:104: 00010000:00010000:0.0:1788842007.522149:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f600/0x3de1064d33a8bdc2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842007.522190:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842007.522798:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489184000 00000100:00100000:3.0:1788842007.522816:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489184000 00010000:00010000:3.0:1788842007.523350:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bda6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23f2 expref: 29 pid: 8623 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842007.523415:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 74 00000100:00100000:3.0:1788842007.523428:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+29:2349:x1875736489184000:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788842007.523447:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788842007.523455:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bda6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23f2 expref: 29 pid: 8623 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842007.523479:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bda6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23f2 expref: 29 pid: 8623 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842007.523550:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8bda6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23f2 expref: 29 pid: 8623 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842007.523574:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a61283700) 00010000:00010000:3.0:1788842007.523581:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f600/0x3de1064d33a8bdc2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842007.523748:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f600/0x3de1064d33a8bdc2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842007.523759:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f600/0x3de1064d33a8bdc2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842007.523801:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788842007.523954:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f600/0x3de1064d33a8bdc2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.523977:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f600/0x3de1064d33a8bdc2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788842007.524006:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00000100:00100000:3.0:1788842007.524035:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+28:2349:x1875736489184000:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 606us (1842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842007.524046:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 74 00010000:00010000:0.0:1788842007.524218:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f000/0x3de1064d33a8bdbb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23f9 expref: 29 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.524243:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f600/0x3de1064d33a8bdc2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23f9 expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.524254:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a61283700) 00010000:00010000:0.0:1788842007.524257:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788842007.524276:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c24f600, rc 0) 00000100:00100000:0.0:1788842007.525025:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+28:11075:x1875736489183872:12345-192.168.204.55@tcp:101:bash.0 Request processed in 13112us (14951us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788842007.525036:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 191 00000100:00100000:0.0:1788842007.532983:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842007.533098:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489184256 00000100:00100000:1.0:1788842007.533112:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489184256 00000100:00100000:1.0:1788842007.533195:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 192 00000100:00100000:1.0:1788842007.533271:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+28:11075:x1875736489184256:12345-192.168.204.55@tcp:36:bash.0 00010000:00010000:0.0:1788842007.534145:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bdd0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.534171:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bdd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.534186:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bdd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788842007.534331:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1788842007.534363:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c6dbcae reply state 0000000067d32dc1 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bdd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842007.534375:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788842007.534430:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1788842007.534833:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+32:11075:x1875736489184256:12345-192.168.204.55@tcp:36:bash.0 Request processed in 1623us (1865us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1788842007.534843:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 192 00000020:00080000:0.0:1788842007.534850:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788842007.538188:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842007.538296:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489184384 00000100:00100000:2.0:1788842007.538312:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489184384 00000100:00100000:2.0:1788842007.538394:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 193 00000100:00100000:2.0:1788842007.538408:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+32:11075:x1875736489184384:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:2.0:1788842007.538443:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842007.538472:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bdd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2400 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.538571:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bdd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2400 expref: 33 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.538600:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bdd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2400 expref: 33 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.538626:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a61283700) 00010000:00010000:2.0:1788842007.538630:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788842007.538635:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cdc00, rc 0) 00000100:00100000:2.0:1788842007.538751:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+33:11075:x1875736489184384:12345-192.168.204.55@tcp:101:bash.0 Request processed in 345us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842007.538759:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 193 00000100:00100000:1.0:1788842007.541445:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842007.541570:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489184512 00000100:00100000:3.0:1788842007.541583:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489184512 00000100:00100000:3.0:1788842007.541663:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 58 00000100:00100000:3.0:1788842007.541674:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:11075:x1875736489184512:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:3.0:1788842007.541697:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842007.541768:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024581163/0x3de1064d33a8bdde lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2407 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788842007.541803:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f9012, atime: 0x6a9f9011, ctime: 0x6a9f9012, blocks: 0xb 00010000:00010000:3.0:1788842007.541828:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=335s v=(0 0) 00010000:00010000:3.0:1788842007.541840:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788842007.541851:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024581163/0x3de1064d33a8bdde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2407 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842007.541871:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024581163/0x3de1064d33a8bdde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2407 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842007.541888:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60052a00, rc 0) 00000100:00100000:3.0:1788842007.541965:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:11075:x1875736489184512:12345-192.168.204.55@tcp:101:bash.0 Request processed in 292us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842007.541974:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 58 00010000:00010000:0.0:1788842007.543734:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bdd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.543757:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bdd0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.543766:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bdd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.543796:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78e600 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842007.543802:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bdd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.543811:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bdd0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.543832:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a61283700) 00010000:00010000:0.0:1788842007.543835:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842007.543841:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bdd0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.543848:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bdd0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842007.544803:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842007.544993:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489184640 00000100:00100000:3.0:1788842007.545006:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489184640 00002000:00010000:3.0:1788842007.545060:0:6701:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1788842007.545065:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3a4e0b4000 with x1875736489184640 ext(0->18446744073709551615) 00002000:00010000:3.0:1788842007.545081:0:6701:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d3a4e0b4000. 00000100:00100000:3.0:1788842007.545122:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 5 00000100:00100000:3.0:1788842007.545135:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:2349:x1875736489184640:12345-192.168.204.55@tcp:10:bash.0 00002000:00010000:3.0:1788842007.545515:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788842007.545519:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788842002 -> 1788842006 00002000:00010000:3.0:1788842007.545521:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788842001 -> 1788842001 00002000:00010000:3.0:1788842007.545523:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788842002 -> 1788842006 00002000:00010000:3.0:1788842007.545525:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788842007.545613:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:2349:x1875736489184640:12345-192.168.204.55@tcp:10:bash.0 Request processed in 479us (816us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788842007.545621:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 5 00002000:00010000:3.0:1788842007.545640:0:6701:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1788842007.545643:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3a4e0b4000 with x1875736489184640 ext(0->18446744073709551615) 00002000:00010000:3.0:1788842007.545648:0:6701:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d3a4e0b4000. 00000100:00100000:1.0:1788842007.622895:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842007.623033:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489184768 00000100:00100000:0.0:1788842007.623051:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489184768 00000100:00100000:0.0:1788842007.623143:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 194 00000100:00100000:0.0:1788842007.623157:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+32:11563:x1875736489184768:12345-192.168.204.55@tcp:34:lfs.0 00010000:00010000:0.0:1788842007.623283:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bde5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.623308:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bde5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.623322:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bde5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.623341:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bdec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.623376:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bdec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.623383:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bdec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.623772:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bdf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.623783:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.623792:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788842007.623845:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.623859:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bde5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.623866:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bde5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.623874:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bde5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.623881:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78e600 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842007.623887:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bde5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.623896:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bde5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.623920:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:0.0:1788842007.623923:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842007.623930:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bde5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.623945:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bde5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.623968:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bdec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.623975:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bdec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.623980:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bdec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.623986:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f000 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842007.623989:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bdec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.623996:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bdec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.624004:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3a4e719400) 00010000:00010000:0.0:1788842007.624006:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842007.624009:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bdec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.624015:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8bdec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.624043:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.624049:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bdf3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.624055:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bdf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.624059:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78e200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842007.624062:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bdf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.624068:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bdf3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.624075:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a61283700) 00010000:00010000:0.0:1788842007.624077:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842007.624080:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bdf3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.624087:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bdf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842007.624190:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+32:11563:x1875736489184768:12345-192.168.204.55@tcp:34:lfs.0 Request processed in 1033us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842007.624200:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 194 00000100:00100000:1.0:1788842007.658851:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842007.658976:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489185024 00000100:00100000:0.0:1788842007.658993:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489185024 00000100:00100000:0.0:1788842007.659086:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 195 00000100:00100000:0.0:1788842007.659120:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4e0b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+32:11566:x1875736489185024:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1788842007.659149:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842007.659176:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bdfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef240e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.659289:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be01 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.659309:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.659324:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.659343:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.659351:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.659358:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.659799:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8be0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.659811:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8be0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.659819:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8be0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788842007.659842:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788842007.660009:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.660020:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be01 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.660028:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.660037:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f000 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842007.660043:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.660055:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be01 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.660072:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:0.0:1788842007.660075:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842007.660082:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.660089:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.660117:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.660124:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.660143:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.660149:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78e600 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842007.660153:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.660160:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.660170:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3a4e719400) 00010000:00010000:0.0:1788842007.660172:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842007.660175:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.660181:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.660235:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8bdfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef240e expref: 35 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.660252:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8be0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef240e expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.660260:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a61283700) 00010000:00010000:0.0:1788842007.660263:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788842007.660266:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78f200, rc 0) 00000100:00100000:0.0:1788842007.660381:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4e0b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+34:11566:x1875736489185024:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 1264us (1546us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1788842007.660398:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 195 00000100:00100000:1.0:1788842007.665428:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842007.665820:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489185152 00000100:00100000:3.0:1788842007.665834:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489185152 00000100:00100000:3.0:1788842007.665920:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 196 00000100:00100000:3.0:1788842007.665947:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+34:11566:x1875736489185152:12345-192.168.204.55@tcp:54:lfs.0 00010000:00010000:3.0:1788842007.666053:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8be1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842007.666087:0:8623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f600/0x3de1064d33a8bdc2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23f9 expref: 34 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842007.666098:0:8623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8be1d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842007.666147:0:8623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f600/0x3de1064d33a8bdc2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23f9 expref: 34 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842007.666165:0:8623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f600/0x3de1064d33a8bdc2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23f9 expref: 34 pid: 5851 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842007.666184:0:8623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76864e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8623:1875736500712960:192.168.204.55@tcp:104: 00000100:00100000:3.0:1788842007.666328:0:8623:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3944e29cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788842007.672038:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842007.672282:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489185408 00000100:00100000:2.0:1788842007.672295:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489185408 00000100:00100000:3.0:1788842007.672328:0:8623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76864e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8623:1875736500712960:192.168.204.55@tcp:104: 00010000:00010000:3.0:1788842007.672365:0:8623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8be1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842007.672377:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 52 00000100:00100000:2.0:1788842007.672390:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+35:5590:x1875736489185408:12345-192.168.204.55@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788842007.673463:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+36:5590:x1875736489185408:12345-192.168.204.55@tcp:35:ldlm_bl.0 Request processed in 1063us (1429us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788842007.673478:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 52 00000100:00100000:1.0:1788842007.677978:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842007.678264:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489185536 00000100:00100000:2.0:1788842007.678279:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489185536 00010000:00010000:2.0:1788842007.678335:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f600/0x3de1064d33a8bdc2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23f9 expref: 36 pid: 5851 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842007.678441:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 75 00000100:00100000:2.0:1788842007.678454:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4ec18c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+36:2350:x1875736489185536:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788842007.681659:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788842007.681691:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f600/0x3de1064d33a8bdc2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23f9 expref: 36 pid: 5851 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.681827:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f600/0x3de1064d33a8bdc2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23f9 expref: 36 pid: 5851 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.681954:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f600/0x3de1064d33a8bdc2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23f9 expref: 36 pid: 5851 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.681980:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a61283700) 00010000:00010000:2.0:1788842007.681986:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8be1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.681998:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8be1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.682008:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8be1d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.682204:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788842007.682310:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4ec18c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+35:2350:x1875736489185536:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 3855us (4344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842007.682324:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 75 00010000:00010000:3.0:1788842007.689154:0:8623:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8be1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842007.689177:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8be1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842007.689239:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8be1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842007.689248:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8be1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842007.689257:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8be1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842007.689266:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842007.689271:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8be1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842007.689280:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8be1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842007.689302:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a61283700) 00010000:00010000:3.0:1788842007.689306:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788842007.689312:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8be1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842007.689319:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8be1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842007.689466:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+34:11566:x1875736489185152:12345-192.168.204.55@tcp:54:lfs.0 Request processed in 23526us (24047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842007.689500:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 196 00000100:00100000:1.0:1788842007.708264:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842007.709409:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489185792 00000100:00100000:2.0:1788842007.709427:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489185792 00000100:00100000:2.0:1788842007.709512:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 53 00000100:00100000:2.0:1788842007.709526:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+34:11566:x1875736489185792:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:2.0:1788842007.710683:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+35:11566:x1875736489185792:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 1152us (2429us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788842007.710696:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 53 00000100:00100000:1.0:1788842007.848443:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842007.848578:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489186048 00000100:00100000:0.0:1788842007.848603:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489186048 00000100:00100000:0.0:1788842007.848682:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 197 00000100:00100000:0.0:1788842007.848695:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+35:11577:x1875736489186048:12345-192.168.204.55@tcp:101:cat.0 00010000:00010000:0.0:1788842007.848772:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842007.848803:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8be24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2415 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.848913:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.848941:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.848958:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.848975:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.848982:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.848989:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.849366:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8be39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.849389:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8be39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.849396:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8be39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788842007.849408:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788842007.849527:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.849536:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.849544:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.849551:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78e600 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842007.849556:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.849565:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.849579:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:0.0:1788842007.849582:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842007.849587:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.849594:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.849615:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.849629:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.849635:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.849640:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f000 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842007.849643:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.849649:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.849656:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3a4e719400) 00010000:00010000:0.0:1788842007.849659:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842007.849662:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.849668:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.849773:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8be24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2415 expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.849789:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8be39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2415 expref: 37 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.849797:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a61283700) 00010000:00010000:0.0:1788842007.849800:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788842007.849808:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78f600, rc 0) 00000100:00100000:0.0:1788842007.849894:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+37:11577:x1875736489186048:12345-192.168.204.55@tcp:101:cat.0 Request processed in 1200us (1468us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788842007.849902:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 197 00000100:00100000:1.0:1788842007.855318:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842007.855420:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489186304 00000100:00100000:0.0:1788842007.855435:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489186304 00000100:00100000:0.0:1788842007.855519:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 54 00000100:00100000:0.0:1788842007.855533:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+37:11577:x1875736489186304:12345-192.168.204.55@tcp:35:cat.0 00000100:00100000:0.0:1788842007.855941:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+38:11577:x1875736489186304:12345-192.168.204.55@tcp:35:cat.0 Request processed in 400us (633us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788842007.855951:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 54 00000100:00100000:1.0:1788842007.906481:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842007.906953:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489186560 00000100:00100000:0.0:1788842007.906969:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489186560 00000100:00100000:0.0:1788842007.907052:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 198 00000100:00100000:0.0:1788842007.907065:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+38:11578:x1875736489186560:12345-192.168.204.55@tcp:36:rm.0 00010000:00010000:0.0:1788842007.907154:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788842007.907211:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8be39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2415 expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.907250:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8be0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef240e expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.907265:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8bdd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2400 expref: 36 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.907277:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a61283700) 00010000:00010000:0.0:1788842007.907290:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788842007.907334:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8be47 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.907353:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8be47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.907365:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8be47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.907382:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.907390:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.907396:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.908192:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be55 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.908217:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.908227:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788842007.910788:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1788842007.910813:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 336068103023ns, next at 337068097928ns, rc = 0 00010000:00010000:0.0:1788842007.910946:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8be5c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.910969:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8be5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.911002:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8be5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.911013:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8be5c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.911020:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8be5c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.911028:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8be5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.911185:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788842007.911226:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.911233:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be55 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.911239:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be55 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.911245:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78e600 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842007.911250:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be55 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.911258:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be55 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.911273:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a4e719700) 00010000:00010000:0.0:1788842007.911276:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788842007.911289:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be55 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.911295:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8be55 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.911327:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8be47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.911333:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8be47 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.911340:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8be47 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.911346:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78e200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842007.911349:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8be47 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.911356:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8be47 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.911363:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:0.0:1788842007.911366:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842007.911369:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8be47 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842007.911375:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8be47 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788842007.911386:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016e05ee8 reply state 000000007fdb54ad transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842007.911420:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788842007.911565:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+37:11578:x1875736489186560:12345-192.168.204.55@tcp:36:rm.0 Request processed in 4494us (5093us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788842007.911575:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 198 00010000:00010000:2.0:1788842007.922974:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.923001:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.923010:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.923017:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f000 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842007.923024:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.923033:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be4e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.923286:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3a4e719400) 00010000:00010000:2.0:1788842007.923310:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842007.923318:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be4e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.923327:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f000/0x3de1064d33a8be4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.923946:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788842007.923958:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8be5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.923966:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78fa00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842007.923970:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8be5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.923980:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8be5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.923993:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3a4e719700) 00010000:00010000:1.0:1788842007.923996:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788842007.924000:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8be5c lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.924005:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fa00/0x3de1064d33a8be5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.924022:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842007.924025:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842007.924037:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788842007.980496:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842007.981033:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489186816 00000100:00100000:3.0:1788842007.981047:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489186816 00000100:00100000:3.0:1788842007.981135:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 199 00000100:00100000:3.0:1788842007.981149:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7687b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+36:11584:x1875736489186816:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:3.0:1788842007.981186:0:8623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842007.981227:0:8623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8be63 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef241c expref: -99 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842007.981393:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8be6a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842007.981412:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8be6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842007.981427:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8be6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842007.981444:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8be71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842007.981451:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8be71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842007.981458:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8be71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788842007.984406:0:8623:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788842007.984962:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24fe00/0x3de1064d33a8be78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.984986:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24fe00/0x3de1064d33a8be78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.985002:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24fe00/0x3de1064d33a8be78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.985169:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8be6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.985179:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8be6a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.985187:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8be6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.985194:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053e00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788842007.985265:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8be6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.985277:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8be6a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.985294:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:1.0:1788842007.985298:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788842007.985304:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8be6a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.985330:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8be6a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788842007.985354:0:8623:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da85ecde reply state 000000004e9af491 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8be71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842007.985364:0:8623:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788842007.985411:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8be63 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef241c expref: 39 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.985428:0:8623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24fe00/0x3de1064d33a8be78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef241c expref: 38 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.985437:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a428df500) 00010000:00010000:1.0:1788842007.985439:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788842007.985442:0:8623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c24fe00, rc 0) 00000100:00100000:1.0:1788842007.986058:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7687b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+39:11584:x1875736489186816:12345-192.168.204.55@tcp:101:bash.0 Request processed in 4894us (5560us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788842007.986071:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 199 00010000:00010000:1.0:1788842007.989775:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8be71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.989802:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8be71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.989812:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8be71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.989820:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788842007.989856:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8be71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.989867:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8be71 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.989890:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3a42af4900) 00010000:00010000:1.0:1788842007.989893:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788842007.989899:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8be71 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842007.989908:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8be71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842007.995951:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842007.996847:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489186944 00000100:00100000:2.0:1788842007.996864:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489186944 00000100:00100000:2.0:1788842007.996956:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 59 00000100:00100000:2.0:1788842007.996968:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2350:x1875736489186944:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:2.0:1788842007.996991:0:8622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842007.997018:0:8622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049d210b4/0x3de1064d33a8be86 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2423 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788842007.997068:0:8622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788842007.997092:0:8622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=336s v=(0 0) 00010000:00010000:2.0:1788842007.997098:0:8622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788842007.997111:0:8622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049d210b4/0x3de1064d33a8be86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2423 expref: 6 pid: 8622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.997135:0:8622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049d210b4/0x3de1064d33a8be86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2423 expref: 6 pid: 8622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842007.997152:0:8622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cc200, rc 0) 00000100:00100000:2.0:1788842007.997231:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2350:x1875736489186944:12345-192.168.204.55@tcp:101:bash.0 Request processed in 265us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842007.997239:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 59 00000100:00100000:0.0:1788842008.003300:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842008.003445:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489187072 00000100:00100000:3.0:1788842008.003458:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489187072 00000100:00100000:3.0:1788842008.003561:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 60 00000100:00100000:3.0:1788842008.003605:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:11584:x1875736489187072:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:3.0:1788842008.003630:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842008.003654:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8be8d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef242a expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.003694:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049d210b4/0x3de1064d33a8be86 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2423 expref: 7 pid: 8622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.003704:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788842008.003750:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788842008.003757:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8be8d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef242a expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.003800:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049d210b4/0x3de1064d33a8be86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2423 expref: 7 pid: 8622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.003816:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049d210b4/0x3de1064d33a8be86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2423 expref: 7 pid: 8622 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842008.003848:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76864e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1875736500713088:192.168.204.55@tcp:104: 00000100:00100000:3.0:1788842008.003975:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3944e29cc0 going to sleep for 11 seconds 00000100:00080000:1.0:1788842008.004452:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788842008.010778:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76864e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1875736500713088:192.168.204.55@tcp:104: 00010000:00010000:3.0:1788842008.010895:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8be8d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef242a expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.010961:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60052800, rc 0) 00000100:00100000:3.0:1788842008.011034:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:11584:x1875736489187072:12345-192.168.204.55@tcp:101:bash.0 Request processed in 7432us (7749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842008.012700:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 60 00000100:00100000:2.0:1788842008.015361:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842008.015506:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489187200 00000100:00100000:1.0:1788842008.015702:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489187200 00010000:00010000:1.0:1788842008.015791:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049d210b4/0x3de1064d33a8be86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2423 expref: 7 pid: 8622 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842008.015894:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 76 00000100:00100000:1.0:1788842008.015906:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c254a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2352:x1875736489187200:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788842008.015935:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788842008.015967:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049d210b4/0x3de1064d33a8be86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2423 expref: 7 pid: 8622 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.015984:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049d210b4/0x3de1064d33a8be86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2423 expref: 7 pid: 8622 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.016039:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049d210b4/0x3de1064d33a8be86 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2423 expref: 7 pid: 8622 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.016077:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842008.016081:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842008.016092:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8be8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef242a expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.016103:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8be8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef242a expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.016152:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8be8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef242a expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842008.016169:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c476300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5836:1875736500713216:192.168.204.55@tcp:105: 00000100:00100000:1.0:1788842008.016289:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d39456a4900 going to sleep for 11 seconds 00000100:00100000:1.0:1788842008.022159:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c476300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5836:1875736500713216:192.168.204.55@tcp:105: 00010000:00010000:1.0:1788842008.022761:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788842008.022922:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c254a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2352:x1875736489187200:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 7015us (7574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842008.022946:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 76 00000100:00100000:2.0:1788842008.026184:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842008.026416:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489187456 00000100:00100000:0.0:1788842008.026432:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489187456 00000100:00100000:0.0:1788842008.026521:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 55 00000100:00100000:0.0:1788842008.026546:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+38:11584:x1875736489187456:12345-192.168.204.55@tcp:35:bash.0 00000100:00100000:0.0:1788842008.027724:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+39:11584:x1875736489187456:12345-192.168.204.55@tcp:35:bash.0 Request processed in 1165us (1529us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788842008.027737:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 55 00000100:00100000:3.0:1788842008.215298:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842008.215464:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489187584 00000100:00100000:2.0:1788842008.215477:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489187584 00000100:00100000:2.0:1788842008.215567:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 200 00000100:00100000:2.0:1788842008.215580:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+39:11600:x1875736489187584:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1788842008.215613:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842008.215642:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8be94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2431 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.215766:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8be9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.215784:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8be9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.215797:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8be9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788842008.216000:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788842008.216005:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788842008.216029:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8be9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.216394:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8be94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2431 expref: 41 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.216476:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8be9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2431 expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.216512:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:2.0:1788842008.216516:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788842008.216521:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cdc00, rc 0) 00000100:00100000:2.0:1788842008.216884:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+40:11600:x1875736489187584:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 1304us (1600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842008.216893:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 200 00000100:00100000:1.0:1788842008.227004:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842008.227255:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489187840 00000100:00100000:0.0:1788842008.227267:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489187840 00000100:00100000:0.0:1788842008.227345:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 201 00000100:00100000:0.0:1788842008.227358:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+40:11600:x1875736489187840:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1788842008.227385:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842008.227414:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bea2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2438 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.227586:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8bea9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.227605:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8bea9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.227620:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8bea9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788842008.227653:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788842008.227865:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e600/0x3de1064d33a8bea2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2438 expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.227896:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8bea9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2438 expref: 42 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.227907:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a428df500) 00010000:00010000:0.0:1788842008.227911:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788842008.227915:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78f200, rc 0) 00000100:00100000:0.0:1788842008.228011:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+42:11600:x1875736489187840:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 655us (1023us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788842008.228020:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 201 00000100:00100000:2.0:1788842008.232023:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842008.232323:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489188096 00000100:00100000:3.0:1788842008.232337:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489188096 00000100:00100000:3.0:1788842008.232428:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00100000:3.0:1788842008.232441:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c256300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+42:2349:x1875736489188096:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788842008.232473:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788842008.232511:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8bea9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2438 expref: 42 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.232552:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a428df500) 00010000:00010000:3.0:1788842008.232559:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788842008.233088:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c256300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+41:2349:x1875736489188096:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 646us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842008.233098:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00100000:3.0:1788842008.234398:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842008.234538:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489188224 00000100:00100000:1.0:1788842008.234549:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489188224 00000100:00100000:1.0:1788842008.234677:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 202 00000100:00100000:1.0:1788842008.234689:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+41:11600:x1875736489188224:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1788842008.234768:0:8623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788842008.234796:0:8623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24fc00/0x3de1064d33a8beb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef243f expref: -99 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.234937:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bebe lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.234958:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bebe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.234972:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bebe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788842008.234988:0:8623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788842008.235152:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24fc00/0x3de1064d33a8beb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef243f expref: 44 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.235175:0:8623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bebe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef243f expref: 43 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.235186:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a428df500) 00010000:00010000:1.0:1788842008.235189:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788842008.235204:0:8623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c24f200, rc 0) 00000100:00100000:1.0:1788842008.235268:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+43:11600:x1875736489188224:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 580us (878us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788842008.235275:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 202 00000100:00100000:1.0:1788842008.247295:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842008.247432:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489188352 00000100:00100000:2.0:1788842008.247446:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489188352 00000100:00100000:2.0:1788842008.247526:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 61 00000100:00100000:2.0:1788842008.247539:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7d87f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+6:2350:x1875736489188352:12345-192.168.204.55@tcp:1:lfs.0 00010000:00010000:2.0:1788842008.247609:0:8622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003326e811/0x3de1064d33a8becc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.247635:0:8622:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8be8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef242a expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.247645:0:8622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788842008.247650:0:8622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788842008.247654:0:8622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003326e811/0x3de1064d33a8becc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.247701:0:8622:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8be8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef242a expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.247777:0:8622:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8be8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef242a expref: 6 pid: 6696 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842008.247798:0:8622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c256680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8622:1875736500713344:192.168.204.55@tcp:104: 00000100:00100000:2.0:1788842008.247916:0:8622:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a47a3d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788842008.252020:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842008.252159:0:8622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c256680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8622:1875736500713344:192.168.204.55@tcp:104: 00010000:00010000:1.0:1788842008.252205:0:8622:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003326e811/0x3de1064d33a8becc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842008.252341:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489188480 00000100:00100000:3.0:1788842008.252350:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489188480 00002000:00100000:3.0:1788842008.252413:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8d3a7c254380 x1875736489188480/t0(0) o4->090c7b3c-cdb1-4c0e-9553-671552ee3fa2@192.168.204.55@tcp:134/0 lens 504/0 e 0 to 0 dl 1788842019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788842008.252424:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3a7c254380 with x1875736489188480 ext(0->8) 00010000:00010000:3.0:1788842008.252432:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8be8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef242a expref: 7 pid: 6696 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.252466:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8be8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef242a expref: 7 pid: 6696 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788842008.252475:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d3a7c254380 00000100:00100000:3.0:1788842008.252518:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 3 00000100:00100000:3.0:1788842008.252530:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2349:x1875736489188480:12345-192.168.204.55@tcp:4:lfs.0 00000100:00100000:3.0:1788842008.253505:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:2349:x1875736489188480:12345-192.168.204.55@tcp:4:lfs.0 Request processed in 970us (1493us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788842008.253517:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 3 00002000:00100000:3.0:1788842008.253528:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8d3a7c254380 x1875736489188480/t4294967308(0) o4->090c7b3c-cdb1-4c0e-9553-671552ee3fa2@192.168.204.55@tcp:134/0 lens 504/448 e 0 to 0 dl 1788842019 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788842008.253538:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3a7c254380 with x1875736489188480 ext(0->8) 00010000:00010000:3.0:1788842008.253555:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8be8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef242a expref: 9 pid: 6696 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.253581:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8be8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef242a expref: 9 pid: 6696 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788842008.253590:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d3a7c254380 00000100:00100000:0.0:1788842008.256953:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842008.257071:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489188608 00000100:00100000:3.0:1788842008.257087:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489188608 00010000:00010000:3.0:1788842008.257145:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8be8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef242a expref: 9 pid: 6696 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842008.257437:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 77 00000100:00100000:3.0:1788842008.257450:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c244a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:2350:x1875736489188608:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788842008.257473:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788842008.257500:0:8449:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788842008.257503:0:8449:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788842007 00002000:00010000:3.0:1788842008.257506:0:8449:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788842007 00002000:00010000:3.0:1788842008.257508:0:8449:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788842007 00010000:00010000:3.0:1788842008.257514:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8be8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef242a expref: 9 pid: 6696 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.257541:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8be8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef242a expref: 9 pid: 6696 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.257578:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009331d965/0x3de1064d33a8be8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef242a expref: 9 pid: 6696 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.257603:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788842008.257608:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788842008.257615:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003326e811/0x3de1064d33a8becc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.257625:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003326e811/0x3de1064d33a8becc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.259804:0:8622:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003326e811/0x3de1064d33a8becc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.259829:0:8622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003326e811/0x3de1064d33a8becc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.259880:0:8622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003326e811/0x3de1064d33a8becc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.259891:0:8622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003326e811/0x3de1064d33a8becc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.259901:0:8622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003326e811/0x3de1064d33a8becc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.259909:0:8622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd600 already unused, calling callback (ffffffffc1813420) 00010000:00010000:2.0:1788842008.259914:0:8622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003326e811/0x3de1064d33a8becc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.259960:0:8622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003326e811/0x3de1064d33a8becc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.259984:0:8622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003326e811/0x3de1064d33a8becc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.259993:0:8622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003326e811/0x3de1064d33a8becc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842008.260125:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7d87f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:2350:x1875736489188352:12345-192.168.204.55@tcp:1:lfs.0 Request processed in 12582us (12843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842008.260138:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 61 00010000:00010000:3.0:1788842008.260304:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788842008.260340:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c244a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2350:x1875736489188608:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 2892us (3401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842008.260350:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 77 00000100:00100000:1.0:1788842008.264989:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842008.265320:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489188864 00000100:00100000:3.0:1788842008.265335:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489188864 00000100:00100000:3.0:1788842008.265414:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 56 00000100:00100000:3.0:1788842008.265427:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a658db850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+43:11600:x1875736489188864:12345-192.168.204.55@tcp:35:lfs.0 00000004:00010000:3.0:1788842008.265517:0:5853:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bebe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef243f expref: 43 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788842008.266077:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1788842008.266125:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1788842008.267166:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1788842008.267323:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bed3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.267351:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24fe00/0x3de1064d33a8be78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef241c expref: 47 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.267362:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bed3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.267418:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24fe00/0x3de1064d33a8be78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef241c expref: 47 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.267438:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24fe00/0x3de1064d33a8be78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef241c expref: 47 pid: 8623 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842008.267457:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76864000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1875736500713472:192.168.204.55@tcp:104: 00000100:00100000:3.0:1788842008.267914:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3944e29cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788842008.271467:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842008.271558:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489188992 00000100:00100000:0.0:1788842008.271834:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489188992 00010000:00010000:0.0:1788842008.271895:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24fe00/0x3de1064d33a8be78 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef241c expref: 48 pid: 8623 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842008.271957:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 78 00000100:00100000:0.0:1788842008.271970:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c255180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+48:2350:x1875736489188992:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788842008.271992:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788842008.272001:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24fe00/0x3de1064d33a8be78 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef241c expref: 48 pid: 8623 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.272018:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24fe00/0x3de1064d33a8be78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef241c expref: 48 pid: 8623 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.272067:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a428df500) 00010000:00010000:0.0:1788842008.272073:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bed3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.272084:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bed3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.272093:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bed3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.272118:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788842008.272243:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c255180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+48:2350:x1875736489188992:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 275us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842008.272253:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 78 00010000:00010000:3.0:1788842008.272489:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24fe00/0x3de1064d33a8be78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef241c expref: 47 pid: 8623 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842008.272511:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76864000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1875736500713472:192.168.204.55@tcp:104: 00010000:00010000:3.0:1788842008.272550:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bed3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.272631:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bed3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.272640:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bed3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788842008.272843:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788842008.273113:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1788842008.273367:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c255500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875736500713600:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788842008.273435:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842008.273469:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a6a10c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788842008.273641:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500713600 00000100:00100000:3.0:1788842008.273647:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500713600 00000100:00100000:3.0:1788842008.273732:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788842008.273741:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5853:x1875736500713600:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788842008.273823:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5853:x1875736500713600:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 84us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842008.273831:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788842008.274837:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788842008.274910:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c255500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875736500713600:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788842008.277180:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1788842008.279264:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c255500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875736500713728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788842008.279365:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842008.279413:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a47a3d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788842008.279533:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500713728 00000100:00100000:3.0:1788842008.279543:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500713728 00000100:00100000:3.0:1788842008.279624:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788842008.279636:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5853:x1875736500713728:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788842008.279972:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5853:x1875736500713728:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 337us (606us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788842008.279982:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788842008.280150:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c255500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875736500713728:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788842008.280277:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1788842008.280343:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bed3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.280357:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bed3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.280366:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bed3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.280372:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788842008.280377:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bed3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.280387:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bed3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.280408:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a428df500) 00010000:00010000:1.0:1788842008.280412:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788842008.280419:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bed3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.280427:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bed3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788842008.280761:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788842008.280894:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1788842008.280910:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 336438199499ns, next at 337438196521ns, rc = 0 00000001:00080000:1.0:1788842008.280917:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788842008.280969:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a428df500) 00010000:00010000:1.0:1788842008.280972:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788842008.280981:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bebe lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef243f expref: 51 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842008.281108:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a658db850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+50:11600:x1875736489188864:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 15682us (16134us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1788842008.281129:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 56 00000020:00080000:1.0:1788842008.281135:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788842008.285126:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842008.285307:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489189120 00000100:00100000:2.0:1788842008.285321:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489189120 00000100:00100000:2.0:1788842008.285425:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 203 00000100:00100000:2.0:1788842008.285438:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+50:11600:x1875736489189120:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1788842008.285470:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842008.285503:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8beda lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2446 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.285598:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8beda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2446 expref: 51 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.285617:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8beda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2446 expref: 51 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.285646:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:2.0:1788842008.285650:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788842008.285664:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cd600, rc 0) 00000100:00100000:2.0:1788842008.285786:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+51:11600:x1875736489189120:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 350us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842008.285793:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 203 00000100:00100000:0.0:1788842008.290179:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842008.290329:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489189376 00000100:00100000:3.0:1788842008.290343:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489189376 00000100:00100000:3.0:1788842008.290418:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 57 00000100:00100000:3.0:1788842008.290430:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+51:11600:x1875736489189376:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:3.0:1788842008.291086:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+52:11600:x1875736489189376:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 655us (917us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1788842008.291096:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 57 00010000:00010000:1.0:1788842008.449961:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788842008.454507:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842008.454641:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489189504 00000100:00100000:1.0:1788842008.454656:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489189504 00000100:00100000:1.0:1788842008.454769:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 204 00000100:00100000:1.0:1788842008.454782:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+52:11610:x1875736489189504:12345-192.168.204.55@tcp:34:lfs.0 00010000:00010000:1.0:1788842008.454904:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bee1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.454935:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bee1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.454950:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bee1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.454967:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8bee8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.455004:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8bee8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.455012:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8bee8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.455125:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8beef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.455135:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8beef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.455141:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8beef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788842008.455194:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8beef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.455210:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bee1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.455218:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bee1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.455226:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bee1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.455233:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24f200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788842008.455237:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bee1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.455246:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bee1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.455268:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:1.0:1788842008.455271:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788842008.455278:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bee1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.455285:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bee1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.455302:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8bee8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.455308:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8bee8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.455314:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8bee8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.455319:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24e600 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788842008.455322:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8bee8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.455327:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8bee8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.455334:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3a428df500) 00010000:00010000:1.0:1788842008.455336:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788842008.455339:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8bee8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.455345:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8bee8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.455369:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8beef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.455376:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8beef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.455381:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8beef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.455387:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24ea00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788842008.455390:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8beef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.455396:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8beef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.455403:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:1.0:1788842008.455405:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788842008.455408:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8beef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.455414:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8beef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842008.455659:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+52:11610:x1875736489189504:12345-192.168.204.55@tcp:34:lfs.0 Request processed in 878us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842008.455670:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 204 00000100:00100000:0.0:1788842008.521100:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842008.521783:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489189760 00000100:00100000:1.0:1788842008.521798:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489189760 00000100:00100000:1.0:1788842008.522089:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 205 00000100:00100000:1.0:1788842008.522122:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+52:11613:x1875736489189760:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1788842008.522152:0:8623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788842008.522179:0:8623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8bef6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef244d expref: -99 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.522361:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8befd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.522381:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8befd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.522395:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8befd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.522413:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bf04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.522494:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bf04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.522503:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bf04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.522662:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f000/0x3de1064d33a8bf0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.522672:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f000/0x3de1064d33a8bf0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.522679:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f000/0x3de1064d33a8bf0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788842008.522703:0:8623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788842008.524077:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8befd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.524093:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8befd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.524101:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8befd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.524108:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24e600 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788842008.524113:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8befd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.524121:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8befd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.524141:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:1.0:1788842008.524145:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788842008.524150:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8befd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.524157:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8befd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.524175:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bf04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.524181:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bf04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.524866:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bf04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.524872:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24f200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788842008.524876:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bf04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.524885:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bf04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.524897:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3a428df500) 00010000:00010000:1.0:1788842008.524900:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788842008.524904:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bf04 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.524911:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bf04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.525011:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8bef6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef244d expref: 55 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.525028:0:8623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f000/0x3de1064d33a8bf0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef244d expref: 54 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.525035:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:1.0:1788842008.525037:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788842008.525040:0:8623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c24f000, rc 0) 00000100:00100000:1.0:1788842008.525138:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+54:11613:x1875736489189760:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 3020us (4053us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788842008.525158:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 205 00000100:00100000:2.0:1788842008.533246:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842008.534613:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489189888 00000100:00100000:3.0:1788842008.534632:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489189888 00000100:00100000:3.0:1788842008.534760:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 206 00000100:00100000:3.0:1788842008.534772:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+54:11613:x1875736489189888:12345-192.168.204.55@tcp:54:lfs.0 00010000:00010000:3.0:1788842008.534869:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.534894:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.534909:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.534953:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.534961:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.534968:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.534975:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842008.534980:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.535216:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.535232:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:3.0:1788842008.535235:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788842008.535241:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.535247:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842008.535392:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+54:11613:x1875736489189888:12345-192.168.204.55@tcp:54:lfs.0 Request processed in 620us (2159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842008.535402:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 206 00000100:00100000:2.0:1788842008.556582:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842008.556689:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489190144 00000100:00100000:1.0:1788842008.556703:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489190144 00000100:00100000:1.0:1788842008.556810:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 58 00000100:00100000:1.0:1788842008.556822:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+54:11613:x1875736489190144:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:0.0:1788842008.557194:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+55:11613:x1875736489190144:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 371us (625us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788842008.557204:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 58 00000100:00100000:1.0:1788842008.699858:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842008.699983:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489190400 00000100:00100000:0.0:1788842008.699997:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489190400 00000100:00100000:0.0:1788842008.700086:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 207 00000100:00100000:0.0:1788842008.700100:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+55:11623:x1875736489190400:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:0.0:1788842008.700137:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842008.700141:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788842008.700175:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8be9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2431 expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.700395:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:0.0:1788842008.700403:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788842008.700421:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8bf20 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2454 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.700615:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bf27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.700632:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bf27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.700645:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bf27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788842008.700657:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788842008.700882:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8bf20 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2454 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.700908:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bf27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2454 expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.700927:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:0.0:1788842008.700930:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788842008.700933:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78fc00, rc 0) 00000100:00100000:0.0:1788842008.702420:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+56:11623:x1875736489190400:12345-192.168.204.55@tcp:101:bash.0 Request processed in 2310us (2566us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788842008.702434:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 207 00000100:00100000:2.0:1788842008.710823:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76864700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500713856:0@lo:400:kworker.0 00000100:00100000:2.0:1788842008.710955:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842008.711102:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500713856 00000100:00100000:1.0:1788842008.711114:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500713856 00000100:00100000:1.0:1788842008.711226:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788842008.711238:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49924850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3308:x1875736500713856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788842008.716495:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500713984:0@lo:400:kworker.0 00000100:00100000:1.0:1788842008.716622:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49924850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3308:x1875736500713856:12345-0@lo:400:kworker.0 Request processed in 5383us (5663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842008.716637:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1788842008.716757:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875736500714112:0@lo:400:kworker.0 00000100:00100000:3.0:1788842008.716811:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842008.716937:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842008.716962:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500714112 00000100:00100000:3.0:1788842008.716971:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500714112 00000100:00100000:3.0:1788842008.717035:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489190656 00000100:00100000:3.0:1788842008.717039:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489190656 00000100:00100000:3.0:1788842008.717066:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788842008.717076:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875736500714112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788842008.717135:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875736500714112:12345-0@lo:400:kworker.0 Request processed in 60us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842008.717142:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788842008.717156:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 208 00000100:00100000:3.0:1788842008.717163:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+56:11623:x1875736489190656:12345-192.168.204.55@tcp:36:bash.0 00000100:00100000:2.0:1788842008.717400:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76864700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500713856:0@lo:400:kworker.0 00000100:00100000:0.0:1788842008.717401:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788842008.717440:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788842008.717454:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4486c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500714240:0@lo:400:kworker.0 00000100:00100000:0.0:1788842008.717489:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842008.717525:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500714240 00000100:00100000:0.0:1788842008.717529:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500714240 00000100:00100000:0.0:1788842008.717574:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788842008.717582:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875736500714240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788842008.717622:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875736500714240:12345-0@lo:400:kworker.0 Request processed in 41us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842008.717630:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788842008.717653:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500713984 00000100:00100000:1.0:1788842008.717657:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500713984 00000100:00100000:0.0:1788842008.717663:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4486c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500714240:0@lo:400:kworker.0 00000100:00100000:1.0:1788842008.717678:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788842008.717685:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500713984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788842008.717825:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500713984:12345-0@lo:400:kworker.0 Request processed in 139us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842008.717832:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788842008.717844:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500713984:0@lo:400:kworker.0 00010000:00010000:3.0:1788842008.717976:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788842008.718014:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bf27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2454 expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.718048:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f000/0x3de1064d33a8bf0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef244d expref: 55 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.718061:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:3.0:1788842008.718068:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788842008.718526:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.718547:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.718559:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788842008.718631:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1788842008.718659:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004adfa427 reply state 00000000aae788ef transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842008.718669:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788842008.719061:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+57:11623:x1875736489190656:12345-192.168.204.55@tcp:36:bash.0 Request processed in 1894us (2121us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788842008.719071:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 208 00000020:00080000:3.0:1788842008.719077:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788842008.719137:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875736500714112:0@lo:400:kworker.0 00000100:00080000:2.0:1788842008.719333:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788842008.719354:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4486f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500714368:0@lo:400:kworker.0 00000100:00100000:2.0:1788842008.719420:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842008.719703:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500714368 00000100:00100000:3.0:1788842008.719753:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500714368 00000100:00100000:3.0:1788842008.719886:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788842008.719897:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500714368:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788842008.719939:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788842008.720523:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500714368:12345-0@lo:400:kworker.0 Request processed in 625us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842008.720533:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788842008.720600:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4486f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500714368:0@lo:400:kworker.0 00000100:00100000:3.0:1788842008.722691:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842008.723873:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489190784 00000100:00100000:0.0:1788842008.723889:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489190784 00000100:00100000:0.0:1788842008.723996:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 209 00000100:00100000:0.0:1788842008.724009:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+57:11623:x1875736489190784:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:0.0:1788842008.724054:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842008.724088:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8bf3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef245b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.724250:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bf43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.724265:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf35 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.724288:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bf43 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.724310:0:5852:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.724321:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bf43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.726659:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.726683:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.726692:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.726699:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842008.726704:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.726739:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf35 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.726768:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:2.0:1788842008.726772:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842008.726776:0:3294:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bf43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.726795:0:3294:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bf43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.726833:0:3294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bf43 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.726885:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf35 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842008.726893:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.727261:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bf43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.727270:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bf43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788842008.727340:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788842008.727345:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788842008.727372:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bf43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.727418:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ec00/0x3de1064d33a8bf3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef245b expref: 58 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.727444:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bf43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef245b expref: 57 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.727451:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:0.0:1788842008.727454:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788842008.727458:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78fe00, rc 0) 00000100:00100000:0.0:1788842008.727568:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+57:11623:x1875736489190784:12345-192.168.204.55@tcp:101:bash.0 Request processed in 3559us (4887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842008.727587:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 209 00000100:00100000:0.0:1788842008.734272:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842008.734559:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489191040 00000100:00100000:3.0:1788842008.734573:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489191040 00000100:00100000:3.0:1788842008.734646:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 59 00000100:00100000:3.0:1788842008.734658:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+57:11623:x1875736489191040:12345-192.168.204.55@tcp:35:bash.0 00000100:00100000:3.0:1788842008.735131:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+58:11623:x1875736489191040:12345-192.168.204.55@tcp:35:bash.0 Request processed in 474us (875us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1788842008.735140:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 59 00000100:00100000:3.0:1788842008.841117:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842008.841280:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489191168 00000100:00100000:1.0:1788842008.841293:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489191168 00000100:00100000:1.0:1788842008.841388:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 210 00000100:00100000:1.0:1788842008.841403:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+58:11629:x1875736489191168:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1788842008.841436:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788842008.841481:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8bf4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2462 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.841587:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bf51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.841607:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bf51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.841621:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bf51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788842008.841670:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788842008.841675:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788842008.841704:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bf51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.841778:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8bf4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2462 expref: 60 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.841803:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bf51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2462 expref: 59 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.841813:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:1.0:1788842008.841816:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788842008.841820:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c24f200, rc 0) 00000100:00100000:1.0:1788842008.841920:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+59:11629:x1875736489191168:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 510us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842008.841928:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 210 00000100:00100000:2.0:1788842008.867347:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842008.867657:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489191296 00000100:00100000:3.0:1788842008.867671:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489191296 00000100:00100000:3.0:1788842008.867835:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 211 00000100:00100000:3.0:1788842008.867850:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+59:11629:x1875736489191296:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1788842008.867877:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842008.867919:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bf58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2469 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868143:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bf5f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868167:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bf5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868202:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bf5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868222:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868231:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868238:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868357:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bf6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868366:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bf6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868373:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bf6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788842008.868431:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788842008.868436:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788842008.868459:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bf6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868473:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bf6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868484:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bf5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868510:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bf5f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868518:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bf5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868525:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053e00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842008.868531:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bf5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868539:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bf5f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868554:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:3.0:1788842008.868557:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788842008.868562:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bf5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868569:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8bf5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868591:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868597:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868604:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868609:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842008.868618:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868625:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868634:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3a42af4f00) 00010000:00010000:3.0:1788842008.868637:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788842008.868640:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868646:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bf66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868682:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bf58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2469 expref: 61 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868695:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bf6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2469 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842008.868702:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:3.0:1788842008.868704:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788842008.868749:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60053800, rc 0) 00000100:00100000:3.0:1788842008.868835:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+60:11629:x1875736489191296:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 989us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842008.868843:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 211 00000100:00100000:0.0:1788842008.877773:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842008.877841:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842008.878318:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489191424 00000100:00100000:1.0:1788842008.878352:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489191424 00000100:00100000:1.0:1788842008.878452:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:1.0:1788842008.878465:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c245880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+60:2352:x1875736489191424:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788842008.878484:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788842008.878530:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8bf6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2469 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.878559:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:1.0:1788842008.878565:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788842008.878644:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c245880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+59:2352:x1875736489191424:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 182us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842008.878652:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:2.0:1788842008.879445:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489191680 00000100:00100000:2.0:1788842008.879461:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489191680 00000100:00100000:2.0:1788842008.882057:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 212 00000100:00100000:2.0:1788842008.882081:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+59:11629:x1875736489191680:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1788842008.882500:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842008.882540:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bf74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2470 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.882692:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8bf7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.882745:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bf43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef245b expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.882755:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8bf7b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.882803:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bf43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef245b expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.882821:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bf43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef245b expref: 60 pid: 5852 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842008.882838:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c244e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875736500714496:192.168.204.55@tcp:104: 00000100:00100000:0.0:1788842008.882999:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788842008.892847:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842008.893857:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c244e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875736500714496:192.168.204.55@tcp:104: 00010000:00010000:2.0:1788842008.893890:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8bf7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842008.893993:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489191808 00000100:00100000:1.0:1788842008.894000:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489191808 00010000:00010000:1.0:1788842008.894037:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bf43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef245b expref: 61 pid: 5852 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842008.894077:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 79 00000100:00100000:1.0:1788842008.894086:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c247100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+61:2350:x1875736489191808:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788842008.894104:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788842008.894111:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bf43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef245b expref: 61 pid: 5852 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.894122:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bf43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef245b expref: 61 pid: 5852 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.894145:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fe00/0x3de1064d33a8bf43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef245b expref: 61 pid: 5852 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.894180:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:1.0:1788842008.894185:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8bf7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.894195:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8bf7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.894202:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8bf7b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.894232:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788842008.894293:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c247100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+60:2350:x1875736489191808:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 207us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842008.894300:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 79 00010000:00010000:0.0:1788842008.894538:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8bf7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.894555:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8bf7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788842008.894575:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788842008.894754:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78fc00/0x3de1064d33a8bf74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2470 expref: 61 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.894771:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8bf7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2470 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.894778:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:0.0:1788842008.894781:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788842008.894784:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78e400, rc 0) 00000100:00100000:0.0:1788842008.894853:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+60:11629:x1875736489191680:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 12783us (17011us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788842008.894860:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 212 00000100:00100000:0.0:1788842008.912763:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842008.912838:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489192064 00000100:00100000:1.0:1788842008.912849:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489192064 00000100:00100000:1.0:1788842008.912929:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:1.0:1788842008.912941:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4ec1a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+60:11629:x1875736489192064:12345-192.168.204.55@tcp:103:lfs.0 00010000:00010000:1.0:1788842008.912959:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788842008.912984:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8beda lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2446 expref: 60 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.913001:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:1.0:1788842008.913006:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788842008.913066:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4ec1a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+59:11629:x1875736489192064:12345-192.168.204.55@tcp:103:lfs.0 Request processed in 128us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842008.913074:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:3.0:1788842008.915554:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842008.915648:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489192192 00000100:00100000:1.0:1788842008.915657:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489192192 00000100:00100000:1.0:1788842008.915748:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 213 00000100:00100000:1.0:1788842008.915760:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+59:11629:x1875736489192192:12345-192.168.204.55@tcp:58:lfs.0 00010000:00010000:1.0:1788842008.915890:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8bf89 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.915925:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8bf89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842008.915938:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8bf89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788842008.916144:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788842008.916235:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+59:11629:x1875736489192192:12345-192.168.204.55@tcp:58:lfs.0 Request processed in 476us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842008.916243:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 213 00000100:00100000:3.0:1788842008.918620:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842008.919322:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489192320 00000100:00100000:0.0:1788842008.919331:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489192320 00000100:00100000:0.0:1788842008.919392:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 214 00000100:00100000:0.0:1788842008.919402:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4486c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+59:11629:x1875736489192320:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1788842008.919422:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842008.919442:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8bf90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2477 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.919497:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8bf89 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.919525:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8bf90 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2477 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.919544:0:5851:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8bf89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.919558:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8bf90 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2477 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.919572:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:0.0:1788842008.919575:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788842008.919579:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8bf90 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2477 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842008.919586:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78f800, rc 0) 00000100:00100000:0.0:1788842008.919642:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4486c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+60:11629:x1875736489192320:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 242us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842008.919648:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 214 00000100:00100000:3.0:1788842009.218337:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500714624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788842009.218433:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842009.219600:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500714624 00000100:00100000:0.0:1788842009.219611:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500714624 00000100:00100000:0.0:1788842009.219664:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788842009.219675:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875736500714624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788842009.219696:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788842009.219793:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875736500714624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842009.219802:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788842009.219861:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500714624:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788842009.288509:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788842009.288519:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788842009.288581:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788842009.288586:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788842009.288745:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c4b1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11681:1875736500714752:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788842009.288836:0:11681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3944e293c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788842009.297250:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842009.297459:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c4b1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11681:1875736500714752:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788842009.298625:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489192448 00000100:00100000:2.0:1788842009.298647:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489192448 00000100:00100000:2.0:1788842009.298757:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 215 00000100:00100000:2.0:1788842009.298768:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+60:11630:x1875736489192448:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788842009.298798:0:5852:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788842009.298898:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+60:11630:x1875736489192448:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 Request processed in 132us (1658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842009.299200:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 215 00000100:00080000:3.0:1788842009.302270:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788842009.314604:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000001:00080000:0.0:1788842009.315449:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:0.0:1788842009.315467:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1788842009.315471:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1788842009.315758:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489192576 00000100:00100000:2.0:1788842009.315790:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489192576 00000100:00100000:2.0:1788842009.315884:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 216 00000100:00100000:2.0:1788842009.315897:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+60:11630:x1875736489192576:12345-192.168.204.55@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788842009.320146:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8bf97 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320190:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8bf97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320205:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8bf97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320225:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8bf9e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320232:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8bf9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320238:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8bf9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320264:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bfa5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320274:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bfa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320281:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bfa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788842009.320334:0:8623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788842009.320340:0:8623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788842009.320380:0:8623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bfa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320392:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8bf97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320399:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8bf97 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320407:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8bf97 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320413:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cc000 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842009.320417:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8bf97 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320426:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8bf97 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320440:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d3a428df000) 00010000:00010000:2.0:1788842009.320443:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842009.320448:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8bf97 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320455:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8bf97 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320474:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8bf9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320481:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8bf9e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320488:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8bf9e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320506:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cce00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842009.320509:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8bf9e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320514:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8bf9e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320520:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8d3a61283700) 00010000:00010000:2.0:1788842009.320523:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842009.320526:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8bf9e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320532:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8bf9e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320545:0:8623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bfa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320551:0:8623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bfa5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320558:0:8623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bfa5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320563:0:8623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842009.320565:0:8623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bfa5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320569:0:8623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bfa5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320586:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:2.0:1788842009.320588:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842009.320590:0:8623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bfa5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.320596:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bfa5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842009.320759:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+60:11630:x1875736489192576:12345-192.168.204.55@tcp:34:lhsmtool_posix.0 Request processed in 4815us (6116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842009.320771:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 216 00000100:00100000:2.0:1788842009.328258:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842009.328411:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489192832 00000100:00100000:1.0:1788842009.328425:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489192832 00000100:00100000:1.0:1788842009.328501:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 217 00000100:00100000:1.0:1788842009.328514:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+60:11630:x1875736489192832:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788842009.328541:0:6963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788842009.328568:0:6963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8bfac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef247e expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.328690:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ec00/0x3de1064d33a8bfb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.328766:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ec00/0x3de1064d33a8bfb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.328779:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ec00/0x3de1064d33a8bfb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788842009.328794:0:6963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788842009.328952:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ec00/0x3de1064d33a8bfb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.328961:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ec00/0x3de1064d33a8bfb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.329136:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ec00/0x3de1064d33a8bfb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.329144:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24ec00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788842009.329150:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ec00/0x3de1064d33a8bfb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.329159:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ec00/0x3de1064d33a8bfb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.329175:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:1.0:1788842009.329178:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788842009.329183:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ec00/0x3de1064d33a8bfb3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.329190:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ec00/0x3de1064d33a8bfb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.329249:0:6963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8bfac lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef247e expref: 62 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.329273:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d3a428df000) 00010000:00010000:1.0:1788842009.329276:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788842009.329281:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8bfac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef247e expref: 62 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.329291:0:6963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c24e600, rc 0) 00000100:00100000:1.0:1788842009.329439:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+61:11630:x1875736489192832:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 926us (1193us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1788842009.329448:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 217 00000100:00100000:0.0:1788842009.344511:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842009.344687:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489192960 00000100:00100000:2.0:1788842009.344701:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489192960 00000100:00100000:2.0:1788842009.344826:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 218 00000100:00100000:2.0:1788842009.344838:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+61:11630:x1875736489192960:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788842009.344931:0:5852:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788842009.345086:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+61:11630:x1875736489192960:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 Request processed in 250us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842009.345097:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 218 00000100:00100000:1.0:1788842009.354221:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842009.355183:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489193216 00000100:00100000:2.0:1788842009.355199:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489193216 00000100:00100000:2.0:1788842009.355278:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 219 00000100:00100000:2.0:1788842009.355289:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+61:11630:x1875736489193216:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788842009.355314:0:8623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842009.355319:0:8623:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788842009.355368:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8bf51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2462 expref: 61 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.355392:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:2.0:1788842009.355399:0:8623:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788842009.355415:0:8623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bfc1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2485 expref: -99 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788842009.356233:0:8623:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788842009.356473:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8bfc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.356490:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8bfc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.356502:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8bfc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.358432:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8bfc1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2485 expref: 63 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.358468:0:8623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8bfc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2485 expref: 62 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.358479:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d3a61283700) 00010000:00010000:2.0:1788842009.358483:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788842009.358488:0:8623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cce00, rc 0) 00000100:00100000:2.0:1788842009.359943:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+62:11630:x1875736489193216:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 4638us (5718us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788842009.359992:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 219 00000100:00100000:3.0:1788842009.368078:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842009.368219:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489193472 00000100:00100000:1.0:1788842009.368234:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489193472 00000100:00100000:1.0:1788842009.368324:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 220 00000100:00100000:1.0:1788842009.368345:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+62:11630:x1875736489193472:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788842009.368425:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788842009.368459:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cce00/0x3de1064d33a8bfc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2485 expref: 62 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.368484:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d3a61283700) 00010000:00010000:1.0:1788842009.368499:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788842009.368529:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8bfd6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.368546:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8bfd6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.368589:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8bfd6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.368607:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ec00/0x3de1064d33a8bfdd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xc68151ed bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.368616:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ec00/0x3de1064d33a8bfdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc68151ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.368621:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ec00/0x3de1064d33a8bfdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc68151ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.368754:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8bfd6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.368763:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8bfd6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.368769:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8bfd6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.368776:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24e600 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788842009.368782:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8bfd6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.368790:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8bfd6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.368799:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:1.0:1788842009.368803:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788842009.368807:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8bfd6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.368819:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8bfd6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.368830:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ec00/0x3de1064d33a8bfdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc68151ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.368837:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ec00/0x3de1064d33a8bfdd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc68151ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.368842:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ec00/0x3de1064d33a8bfdd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc68151ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.368846:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24ec00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788842009.368848:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ec00/0x3de1064d33a8bfdd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc68151ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.368855:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ec00/0x3de1064d33a8bfdd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc68151ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.368862:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xc68151ed (ffff8d3a428df500) 00010000:00010000:1.0:1788842009.368864:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788842009.368866:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ec00/0x3de1064d33a8bfdd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc68151ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.368872:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ec00/0x3de1064d33a8bfdd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc68151ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842009.368981:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+61:11630:x1875736489193472:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 647us (918us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788842009.368990:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 220 00000100:00100000:0.0:1788842009.372848:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842009.373131:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489193600 00000100:00100000:3.0:1788842009.373144:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489193600 00000100:00100000:3.0:1788842009.373209:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 221 00000100:00100000:3.0:1788842009.373220:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+61:11630:x1875736489193600:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788842009.373245:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842009.373283:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bfe4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef248c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.373327:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bfeb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.373399:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bfeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.373412:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bfeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.373535:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8bfe4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef248c expref: 63 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.373912:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bfeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef248c expref: 62 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.373923:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d3a42af4f00) 00010000:00010000:3.0:1788842009.373927:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788842009.373930:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60052400, rc 0) 00000100:00100000:3.0:1788842009.374240:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+62:11630:x1875736489193600:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 1019us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842009.374249:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 221 00000100:00100000:0.0:1788842009.378941:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842009.379362:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489193856 00000100:00100000:2.0:1788842009.379375:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489193856 00000100:00100000:2.0:1788842009.379457:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 222 00000100:00100000:2.0:1788842009.379471:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+62:11630:x1875736489193856:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788842009.379598:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8bff2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.379619:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8bff2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.379633:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8bff2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788842009.382207:0:8623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:3.0:1788842009.382230:0:8623:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 337539520593ns, next at 338539516123ns, rc = 0 00000004:00010000:3.0:1788842009.382376:0:8623:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9585726 reply state 000000008dd4a8e1 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8bff2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842009.382392:0:8623:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788842009.382563:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+64:11630:x1875736489193856:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 3089us (3630us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1788842009.382574:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 222 00010000:00010000:1.0:1788842009.385108:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8bff2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.385133:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8bff2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.385143:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8bff2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.385150:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cc000 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788842009.385156:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8bff2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.385166:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8bff2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.385202:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d3a42af4f00) 00010000:00010000:1.0:1788842009.385206:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788842009.385214:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8bff2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.385220:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8bff2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842009.386599:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842009.386827:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489193984 00000100:00100000:2.0:1788842009.386841:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489193984 00000100:00100000:2.0:1788842009.386925:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 223 00000100:00100000:2.0:1788842009.386938:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+63:11630:x1875736489193984:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788842009.387086:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842009.387116:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8bff9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2493 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.387262:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8bff9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2493 expref: 64 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.387280:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8bff9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2493 expref: 64 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.387331:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d3a42af4f00) 00010000:00010000:2.0:1788842009.387334:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788842009.387339:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cc200, rc 0) 00000100:00100000:2.0:1788842009.387421:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+64:11630:x1875736489193984:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 485us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842009.387429:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 223 00000100:00100000:2.0:1788842009.391239:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842009.391441:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489194112 00000100:00100000:3.0:1788842009.391453:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489194112 00000100:00100000:3.0:1788842009.391585:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 62 00000100:00100000:3.0:1788842009.391598:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:2349:x1875736489194112:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788842009.395684:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+10:2349:x1875736489194112:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 Request processed in 4073us (4444us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788842009.395701:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 62 00000100:00080000:2.0:1788842009.396547:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788842009.400051:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842009.400209:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489194368 00000100:00100000:3.0:1788842009.400223:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489194368 00000100:00100000:3.0:1788842009.400298:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 60 00000100:00100000:3.0:1788842009.400310:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+64:11630:x1875736489194368:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788842009.400968:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+65:11630:x1875736489194368:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 656us (927us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1788842009.400979:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 60 00000100:00100000:0.0:1788842009.409515:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842009.409693:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489194624 00000100:00100000:3.0:1788842009.409741:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489194624 00000100:00100000:3.0:1788842009.409815:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 224 00000100:00100000:3.0:1788842009.409827:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+65:11630:x1875736489194624:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788842009.409985:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+65:11630:x1875736489194624:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 160us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842009.409994:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 224 00000100:00100000:2.0:1788842009.414464:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842009.414768:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489194752 00000100:00100000:3.0:1788842009.414780:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489194752 00000100:00100000:3.0:1788842009.414848:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 225 00000100:00100000:3.0:1788842009.414860:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+65:11630:x1875736489194752:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788842009.414886:0:8623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842009.414923:0:8623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8c000 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef249a expref: -99 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.415019:0:8623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8c007 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.415036:0:8623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8c007 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.415072:0:8623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8c007 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788842009.415129:0:8623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788842009.415152:0:8623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8c007 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.415294:0:8623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8c000 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef249a expref: 67 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.415316:0:8623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8c007 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef249a expref: 66 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.415326:0:8623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d3a42af4f00) 00010000:00010000:3.0:1788842009.415329:0:8623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788842009.415333:0:8623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60053e00, rc 0) 00000100:00100000:3.0:1788842009.415414:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+66:11630:x1875736489194752:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 556us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842009.415421:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 225 00000100:00100000:1.0:1788842009.419872:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842009.420292:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489194880 00000100:00100000:2.0:1788842009.420307:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489194880 00000100:00100000:2.0:1788842009.420395:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 63 00000100:00100000:2.0:1788842009.420408:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+10:2350:x1875736489194880:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788842009.420434:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842009.420463:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bfcdfd7/0x3de1064d33a8c00e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef24a1 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788842009.420497:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f9018, blocks: 0x1 00010000:00010000:2.0:1788842009.420522:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=337s v=(0 0) 00010000:00010000:2.0:1788842009.420527:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788842009.420537:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bfcdfd7/0x3de1064d33a8c00e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24a1 expref: 11 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.420918:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003bfcdfd7/0x3de1064d33a8c00e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24a1 expref: 11 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.420963:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cc400, rc 0) 00000100:00100000:0.0:1788842009.421118:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+11:2350:x1875736489194880:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 711us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842009.421128:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 63 00000100:00100000:0.0:1788842009.445193:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842009.446050:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489195136 00000100:00100000:1.0:1788842009.446065:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489195136 00000100:00100000:1.0:1788842009.446212:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 226 00000100:00100000:1.0:1788842009.446225:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+66:11630:x1875736489195136:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788842009.446376:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+66:11630:x1875736489195136:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 153us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842009.446404:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 226 00000100:00100000:2.0:1788842009.453963:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842009.454206:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489195264 00000100:00100000:1.0:1788842009.454220:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489195264 00000100:00100000:1.0:1788842009.454296:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 64 00000100:00100000:1.0:1788842009.454309:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+11:11630:x1875736489195264:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788842009.454335:0:8622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788842009.454358:0:8622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000675e0eb3/0x3de1064d33a8c015 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef24a8 expref: -99 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.454400:0:8622:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003bfcdfd7/0x3de1064d33a8c00e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24a1 expref: 12 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.454410:0:8622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842009.454415:0:8622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842009.454422:0:8622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000675e0eb3/0x3de1064d33a8c015 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24a8 expref: 12 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.454465:0:8622:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003bfcdfd7/0x3de1064d33a8c00e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24a1 expref: 12 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.454481:0:8622:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003bfcdfd7/0x3de1064d33a8c00e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24a1 expref: 12 pid: 6695 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842009.454497:0:8622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4926e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8622:1875736500714880:192.168.204.55@tcp:104: 00000100:00100000:1.0:1788842009.458245:0:8622:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a500c0240 going to sleep for 11 seconds 00000100:00100000:1.0:1788842009.460475:0:8622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4926e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8622:1875736500714880:192.168.204.55@tcp:104: 00010000:00010000:1.0:1788842009.460536:0:8622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000675e0eb3/0x3de1064d33a8c015 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24a8 expref: 12 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.460565:0:8622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c24ec00, rc 0) 00000100:00100000:1.0:1788842009.460636:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+12:11630:x1875736489195264:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 6330us (6798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842009.460648:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 64 00000100:00100000:0.0:1788842009.463695:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842009.463886:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489195392 00000100:00100000:1.0:1788842009.463908:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489195392 00010000:00010000:1.0:1788842009.463961:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003bfcdfd7/0x3de1064d33a8c00e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24a1 expref: 12 pid: 6695 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842009.464064:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 80 00000100:00100000:1.0:1788842009.464076:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+12:2350:x1875736489195392:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788842009.464096:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788842009.464126:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003bfcdfd7/0x3de1064d33a8c00e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24a1 expref: 12 pid: 6695 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.464142:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003bfcdfd7/0x3de1064d33a8c00e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24a1 expref: 12 pid: 6695 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.464180:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bfcdfd7/0x3de1064d33a8c00e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24a1 expref: 12 pid: 6695 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.464202:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842009.464224:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842009.464236:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000675e0eb3/0x3de1064d33a8c015 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24a8 expref: 11 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.464248:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000675e0eb3/0x3de1064d33a8c015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24a8 expref: 11 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.464295:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000675e0eb3/0x3de1064d33a8c015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24a8 expref: 11 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842009.464312:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4926e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5835:1875736500715008:192.168.204.55@tcp:105: 00000100:00100000:1.0:1788842009.464416:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a500c0240 going to sleep for 11 seconds 00000100:00100000:3.0:1788842009.468217:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842009.468435:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489195520 00000100:00100000:0.0:1788842009.468447:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489195520 00002000:00100000:0.0:1788842009.468511:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8d3a7c4b1500 x1875736489195520/t0(0) o4->090c7b3c-cdb1-4c0e-9553-671552ee3fa2@192.168.204.55@tcp:135/0 lens 504/0 e 0 to 0 dl 1788842020 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788842009.468523:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3a7c4b1500 with x1875736489195520 ext(0->12) 00002000:00010000:0.0:1788842009.468530:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d3a7c4b1500 00000100:00100000:0.0:1788842009.468577:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:0.0:1788842009.468588:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+12:2349:x1875736489195520:12345-192.168.204.55@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788842009.469311:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+14:2349:x1875736489195520:12345-192.168.204.55@tcp:4:lhsmtool_posix.0 Request processed in 720us (1104us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1788842009.469327:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 6 00002000:00100000:0.0:1788842009.470214:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8d3a7c4b1500 x1875736489195520/t4294967320(0) o4->090c7b3c-cdb1-4c0e-9553-671552ee3fa2@192.168.204.55@tcp:135/0 lens 504/448 e 0 to 0 dl 1788842020 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788842009.470227:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3a7c4b1500 with x1875736489195520 ext(0->12) 00002000:00010000:0.0:1788842009.470233:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d3a7c4b1500 00000100:00100000:1.0:1788842009.470860:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4926e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5835:1875736500715008:192.168.204.55@tcp:105: 00010000:00010000:1.0:1788842009.470892:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788842009.470961:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+13:2350:x1875736489195392:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 6887us (7282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842009.470980:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 80 00000100:00100000:3.0:1788842009.474039:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842009.474341:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489195648 00000100:00100000:2.0:1788842009.474353:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489195648 00000100:00100000:2.0:1788842009.474423:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 227 00000100:00100000:2.0:1788842009.474436:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+66:11630:x1875736489195648:12345-192.168.204.55@tcp:44:lhsmtool_posix.0 00010000:00010000:0.0:1788842009.475758:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788842009.523454:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000004:00080000:0.0:1788842009.523485:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000001:00080000:0.0:1788842009.523522:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000004:00080000:0.0:1788842009.523537:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:0.0:1788842009.523564:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000020:00080000:0.0:1788842009.523575:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d3a4e70a600 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788842009.523580:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d3a767d0100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d3a7bc08540 00000020:00080000:0.0:1788842009.523584:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d3a767d0d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d3a46191000 00000001:00080000:0.0:1788842009.523614:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1788842009.523620:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:0.0:1788842009.523649:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d3a4e575300 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788842009.523652:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d3a765f6700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d3a46303e40 00000020:00080000:0.0:1788842009.523655:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d3a765f6000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d3a7c439800 00000020:00080000:0.0:1788842009.523673:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:0.0:1788842009.523843:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1788842009.524073:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788842009.524097:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500715136:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788842009.524200:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842009.524288:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500715136 00000100:00100000:0.0:1788842009.524296:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500715136 00000100:00100000:0.0:1788842009.524351:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788842009.524361:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500715136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788842009.524393:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1788842009.524432:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f9017, atime: 0x6a9f9017, ctime: 0x6a9f9017, blocks: 0xb 00010000:00010000:0.0:1788842009.524441:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb4fbe6e/0x3de1064d33a8c01c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.524474:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=337s v=(0 0) 00010000:00010000:0.0:1788842009.524480:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842009.524487:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb4fbe6e/0x3de1064d33a8c01c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.524508:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb4fbe6e/0x3de1064d33a8c01c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.524520:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb4fbe6e/0x3de1064d33a8c01c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.524530:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb4fbe6e/0x3de1064d33a8c01c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.524549:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788842009.525106:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1875736500715136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 744us (904us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788842009.525115:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:0.0:1788842009.525157:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788842009.525165:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb4fbe6e/0x3de1064d33a8c01c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.525175:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78ec00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:0.0:1788842009.525180:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb4fbe6e/0x3de1064d33a8c01c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.525190:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb4fbe6e/0x3de1064d33a8c01c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.525209:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb4fbe6e/0x3de1064d33a8c01c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.525216:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb4fbe6e/0x3de1064d33a8c01c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.525239:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842009.525241:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842009.525242:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788842009.525276:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1788842009.525282:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d3a7616d180, transno 4294967307 00000004:00080000:0.0:1788842009.525294:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:0.0:1788842009.525322:0:3310:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8d3a75cd7b80 x1875736500715136/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788842025 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788842009.525335:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d3a75cd7b80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788842009.525341:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500715136:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788842009.526264:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+20:11630:x1875736489195648:12345-192.168.204.55@tcp:44:lhsmtool_posix.0 Request processed in 51823us (52229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842009.526277:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 227 00000100:00100000:2.0:1788842009.526659:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4926e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500715264:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788842009.526734:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842009.526819:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788842009.526826:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76819180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500715392:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788842009.526851:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842009.530543:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842009.530543:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500715264 00000100:00100000:1.0:1788842009.530560:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500715264 00000100:00100000:0.0:1788842009.530868:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500715392 00000100:00100000:0.0:1788842009.530874:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500715392 00000100:00100000:0.0:1788842009.530939:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489195776 00000100:00100000:0.0:1788842009.530942:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489195776 00000100:00100000:0.0:1788842009.530973:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788842009.530986:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1875736500715392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788842009.531112:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 67 00000100:00100000:2.0:1788842009.531126:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7668ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+13:2349:x1875736489195776:12345-192.168.204.55@tcp:16:lhsmtool_posix.0 00002000:00010000:0.0:1788842009.531262:0:8622:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788842009.531267:0:8622:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788842008 00002000:00010000:0.0:1788842009.531269:0:8622:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788842009.531272:0:8622:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788842008 -> 1788842008 00002000:00010000:0.0:1788842009.531274:0:8622:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788842009.531361:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3307:x1875736500715392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 377us (4507us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788842009.531369:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788842009.531417:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788842009.531424:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1875736500715264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788842009.531441:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1788842009.531465:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7150c7e/0x3de1064d33a8c023 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.531494:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024581163/0x3de1064d33a8bdde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2407 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.531505:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788842009.531510:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788842009.531516:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7150c7e/0x3de1064d33a8c023 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788842009.531768:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d3a76819180/2, rc 0, transno 4294967321 00000100:00100000:2.0:1788842009.531775:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76819180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500715392:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1788842009.534086:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000024581163/0x3de1064d33a8bdde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2407 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.534119:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000024581163/0x3de1064d33a8bdde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2407 expref: 13 pid: 6696 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842009.534141:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75cd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1875736500715520:192.168.204.55@tcp:104: 00000100:00100000:0.0:1788842009.535263:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611c300 going to sleep for 11 seconds 00000100:00100000:3.0:1788842009.537928:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75cd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1875736500715520:192.168.204.55@tcp:104: 00010000:00010000:3.0:1788842009.537978:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f7150c7e/0x3de1064d33a8c023 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842009.538504:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842009.539152:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489195904 00000100:00100000:1.0:1788842009.539165:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489195904 00010000:00010000:1.0:1788842009.539317:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000024581163/0x3de1064d33a8bdde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2407 expref: 14 pid: 6696 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842009.539362:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 81 00000100:00100000:1.0:1788842009.539372:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+14:2349:x1875736489195904:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788842009.539405:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788842009.539411:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000024581163/0x3de1064d33a8bdde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2407 expref: 14 pid: 6696 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.539427:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000024581163/0x3de1064d33a8bdde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2407 expref: 14 pid: 6696 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.539455:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024581163/0x3de1064d33a8bdde lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2407 expref: 14 pid: 6696 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.539477:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788842009.539482:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788842009.539488:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7150c7e/0x3de1064d33a8c023 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.539500:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7150c7e/0x3de1064d33a8c023 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.539530:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788842009.539608:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+13:2349:x1875736489195904:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 236us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842009.539616:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 81 00010000:00010000:1.0:1788842009.539815:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f7150c7e/0x3de1064d33a8c023 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.539825:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7150c7e/0x3de1064d33a8c023 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.539847:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7150c7e/0x3de1064d33a8c023 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.539854:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7150c7e/0x3de1064d33a8c023 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.539872:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788842009.540544:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3307:x1875736500715264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9117us (13807us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788842009.540555:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:1.0:1788842009.540584:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788842009.540592:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7150c7e/0x3de1064d33a8c023 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.540601:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78fc00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842009.540607:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7150c7e/0x3de1064d33a8c023 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.540618:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7150c7e/0x3de1064d33a8c023 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.540636:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7150c7e/0x3de1064d33a8c023 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.540645:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7150c7e/0x3de1064d33a8c023 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.540675:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842009.540677:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842009.540679:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788842009.540754:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d3a4926e300/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788842009.540761:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4926e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500715264:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1788842009.563537:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:1.0:1788842009.563624:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:2.0:1788842009.564012:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7668ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2349:x1875736489195776:12345-192.168.204.55@tcp:16:lhsmtool_posix.0 Request processed in 32880us (33472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842009.564026:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 67 00000100:00100000:0.0:1788842009.566674:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842009.566946:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489196160 00000100:00100000:2.0:1788842009.566959:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489196160 00000100:00100000:2.0:1788842009.567068:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 228 00000100:00100000:2.0:1788842009.567080:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+20:11630:x1875736489196160:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788842009.567186:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788842009.567223:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8c007 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef249a expref: 20 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.567253:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d3a42af4f00) 00010000:00010000:2.0:1788842009.567259:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788842009.567297:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c02a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.567313:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c02a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.567325:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c02a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788842009.567804:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d5ec854 reply state 00000000697ea927 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c02a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842009.567818:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788842009.567966:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+21:11630:x1875736489196160:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 886us (1303us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788842009.567974:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 228 00000100:00100000:0.0:1788842009.570336:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842009.570421:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489196288 00000100:00100000:3.0:1788842009.570433:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489196288 00000100:00100000:3.0:1788842009.570504:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 69 00000100:00100000:3.0:1788842009.570515:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2349:x1875736489196288:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788842009.570823:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788842009.570828:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788842008 -> 1788842007 00002000:00010000:3.0:1788842009.570831:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788842007 00002000:00010000:3.0:1788842009.570834:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788842008 -> 1788842007 00002000:00010000:3.0:1788842009.570836:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788842009.570917:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:2349:x1875736489196288:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 Request processed in 403us (594us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788842009.570925:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 69 00010000:00010000:1.0:1788842009.571049:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c02a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.571060:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c02a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.571070:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c02a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.571078:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788842009.571083:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c02a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.571092:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c02a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.571112:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d3a42af4f00) 00010000:00010000:1.0:1788842009.571115:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788842009.571121:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c02a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.571127:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c02a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842009.576927:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842009.577033:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489196544 00000100:00100000:0.0:1788842009.577105:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489196544 00000100:00100000:0.0:1788842009.577192:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 229 00000100:00100000:0.0:1788842009.577205:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+20:11630:x1875736489196544:12345-192.168.204.55@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788842009.577295:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8c031 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.577315:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bfeb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef248c expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.577332:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8c031 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.577378:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bfeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef248c expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.577412:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bfeb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef248c expref: 20 pid: 5851 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842009.577429:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c210380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875736500715648:192.168.204.55@tcp:104: 00000100:00100000:0.0:1788842009.578285:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611c240 going to sleep for 11 seconds 00000100:00100000:2.0:1788842009.580588:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842009.580765:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489196672 00000100:00100000:3.0:1788842009.580786:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489196672 00010000:00010000:3.0:1788842009.580836:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bfeb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef248c expref: 21 pid: 5851 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842009.580880:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 82 00000100:00100000:3.0:1788842009.580890:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c257b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+21:2349:x1875736489196672:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788842009.580921:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788842009.580930:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bfeb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef248c expref: 21 pid: 5851 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.580970:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bfeb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef248c expref: 21 pid: 5851 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.581000:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d3a42af4f00) 00010000:00010000:3.0:1788842009.581007:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8c031 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.581019:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8c031 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.581028:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8c031 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.581051:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788842009.581114:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c257b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+21:2349:x1875736489196672:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 224us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842009.581123:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 82 00010000:00010000:0.0:1788842009.582638:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8bfeb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef248c expref: 20 pid: 5851 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842009.582663:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c210380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875736500715648:192.168.204.55@tcp:104: 00010000:00010000:0.0:1788842009.582694:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8c031 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.582704:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8c031 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.582742:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8c031 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.582788:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8c031 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.582796:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8c031 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.582803:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8c031 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.582810:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f600 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842009.582837:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8c031 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.582846:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8c031 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.582863:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d3a42af4f00) 00010000:00010000:0.0:1788842009.582867:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788842009.582872:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8c031 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.582879:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8c031 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842009.582988:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+19:11630:x1875736489196544:12345-192.168.204.55@tcp:55:lhsmtool_posix.0 Request processed in 5785us (6975us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788842009.583000:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 229 00000100:00100000:2.0:1788842009.586502:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842009.586694:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489196800 00000100:00100000:1.0:1788842009.586706:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489196800 00000100:00100000:1.0:1788842009.586935:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 70 00000100:00100000:1.0:1788842009.586948:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:2349:x1875736489196800:12345-192.168.204.55@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788842009.587006:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b3323817/0x3de1064d33a8c038 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.587030:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000675e0eb3/0x3de1064d33a8c015 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24a8 expref: 8 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.587040:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842009.587045:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788842009.587051:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3323817/0x3de1064d33a8c038 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.587094:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000675e0eb3/0x3de1064d33a8c015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24a8 expref: 8 pid: 8622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.587111:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000675e0eb3/0x3de1064d33a8c015 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24a8 expref: 8 pid: 8622 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842009.587129:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7681a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1875736500715776:192.168.204.55@tcp:104: 00000100:00100000:1.0:1788842009.587243:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a6827ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788842009.589378:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7681a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6693:1875736500715776:192.168.204.55@tcp:104: 00010000:00010000:3.0:1788842009.589422:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3323817/0x3de1064d33a8c038 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842009.590150:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842009.590641:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489196928 00000100:00100000:1.0:1788842009.590652:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489196928 00010000:00010000:1.0:1788842009.590752:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000675e0eb3/0x3de1064d33a8c015 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24a8 expref: 9 pid: 8622 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842009.590917:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 83 00000100:00100000:1.0:1788842009.590929:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c210380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+9:2350:x1875736489196928:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788842009.590952:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788842009.590982:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000675e0eb3/0x3de1064d33a8c015 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24a8 expref: 9 pid: 8622 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.590997:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000675e0eb3/0x3de1064d33a8c015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24a8 expref: 9 pid: 8622 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.591025:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000675e0eb3/0x3de1064d33a8c015 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24a8 expref: 9 pid: 8622 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.591046:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788842009.591051:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788842009.591058:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3323817/0x3de1064d33a8c038 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.591071:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3323817/0x3de1064d33a8c038 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.591105:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788842009.591183:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c210380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:2350:x1875736489196928:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 245us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842009.591191:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 83 00010000:00010000:0.0:1788842009.591267:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3323817/0x3de1064d33a8c038 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.591278:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3323817/0x3de1064d33a8c038 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.591309:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b3323817/0x3de1064d33a8c038 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.591319:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3323817/0x3de1064d33a8c038 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.591339:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3323817/0x3de1064d33a8c038 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.591348:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24e600 already unused, calling callback (ffffffffc1813420) 00010000:00010000:0.0:1788842009.591353:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3323817/0x3de1064d33a8c038 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.591364:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3323817/0x3de1064d33a8c038 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.591377:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3323817/0x3de1064d33a8c038 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842009.591385:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3323817/0x3de1064d33a8c038 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842009.591436:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2349:x1875736489196800:12345-192.168.204.55@tcp:1:lhsmtool_posix.0 Request processed in 4492us (4949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842009.591445:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 70 00000100:00100000:1.0:1788842009.594938:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842009.595094:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489197184 00000100:00100000:3.0:1788842009.595107:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489197184 00000100:00100000:3.0:1788842009.595266:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 230 00000100:00100000:3.0:1788842009.595279:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7681b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+19:11630:x1875736489197184:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788842009.595393:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8c03f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.595433:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8c03f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.595447:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8c03f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.596116:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8c046 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.596135:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8bff9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2493 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.596145:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8c046 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.596349:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8bff9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2493 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.596368:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8bff9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2493 expref: 20 pid: 5852 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842009.596386:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7668aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875736500715904:192.168.204.55@tcp:104: 00000100:00100000:3.0:1788842009.596615:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c2240 going to sleep for 11 seconds 00000100:00100000:1.0:1788842009.601110:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842009.601200:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489197312 00000100:00100000:2.0:1788842009.601212:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489197312 00010000:00010000:2.0:1788842009.601264:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8bff9 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2493 expref: 21 pid: 5852 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842009.601312:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 84 00000100:00100000:2.0:1788842009.601341:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7681a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+21:2350:x1875736489197312:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788842009.601368:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788842009.601377:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8bff9 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2493 expref: 21 pid: 5852 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.601393:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8bff9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2493 expref: 21 pid: 5852 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.601421:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d3a42af4f00) 00010000:00010000:2.0:1788842009.601428:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8c046 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.601437:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8c046 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.601446:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8c046 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.601468:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788842009.601539:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7681a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+21:2350:x1875736489197312:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 201us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842009.601555:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 84 00010000:00010000:3.0:1788842009.603453:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc200/0x3de1064d33a8bff9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2493 expref: 20 pid: 5852 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842009.603483:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7668aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875736500715904:192.168.204.55@tcp:104: 00010000:00010000:3.0:1788842009.603614:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8c046 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.603646:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8c046 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.603654:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8c046 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788842009.604016:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1788842009.604252:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1788842009.604304:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1788842009.604418:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7668aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1875736500716032:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788842009.604567:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842009.604619:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a50cfb300 going to sleep for 11 seconds 00000100:00100000:2.0:1788842009.604655:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500716032 00000100:00100000:2.0:1788842009.604664:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500716032 00000100:00100000:2.0:1788842009.604754:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788842009.604766:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1875736500716032:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788842009.604866:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1875736500716032:12345-0@lo:1000:mdt00_000.0 Request processed in 103us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842009.604889:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788842009.605255:0:5850:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1788842009.605262:0:5850:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1788842009.605287:0:5850:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d3a76819180, transno 4294967321 00000100:00100000:3.0:1788842009.605313:0:5850:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8d3a4926e300 x1875736500715264/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788842025 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788842009.605328:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7668aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1875736500716032:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788842009.606325:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1788842009.606407:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7668aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1875736500716160:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788842009.606466:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842009.606499:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c2240 going to sleep for 11 seconds 00000100:00100000:2.0:1788842009.606754:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500716160 00000100:00100000:2.0:1788842009.606762:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500716160 00000100:00100000:2.0:1788842009.606922:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788842009.606933:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7668bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1875736500716160:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788842009.607183:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7668bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5850:x1875736500716160:12345-0@lo:1000:mdt00_000.0 Request processed in 251us (716us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788842009.607192:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788842009.607276:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7668aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1875736500716160:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788842009.607322:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8c046 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.607334:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8c046 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.607354:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8c046 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.607361:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842009.607366:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8c046 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.607376:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8c046 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.607395:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d3a42af4f00) 00010000:00010000:3.0:1788842009.607398:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788842009.607403:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8c046 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.607410:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8c046 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.607443:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8bf89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.607449:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8bf89 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.607456:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8bf89 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.607461:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24ea00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842009.607463:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8bf89 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.607478:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8bf89 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.607486:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:3.0:1788842009.607488:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788842009.607497:0:5850:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8bf90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2477 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.607509:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8bf90 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2477 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.607521:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8bf90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2477 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.607562:0:5850:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8bf90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2477 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842009.607575:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7668b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875736500716288:192.168.204.55@tcp:105: 00000100:00100000:3.0:1788842009.607661:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c2240 going to sleep for 11 seconds 00000100:00100000:3.0:1788842009.611078:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7668b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875736500716288:192.168.204.55@tcp:105: 00010000:00010000:3.0:1788842009.611121:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8bf89 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.611135:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24ea00/0x3de1064d33a8bf89 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.611190:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8c04d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.611229:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8c04d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.611242:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8c04d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.611252:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8c04d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.611259:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8c04d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.611267:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8c04d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.611273:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053e00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842009.611276:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8c04d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.611283:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8c04d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.611293:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:3.0:1788842009.611296:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788842009.611301:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8c04d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.611306:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8c04d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.611321:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8c03f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.611333:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8c03f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.611339:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8c03f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.611345:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842009.611347:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8c03f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.611353:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8c03f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.611362:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:3.0:1788842009.611365:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788842009.611368:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8c03f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.611373:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8c03f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842009.611867:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7681b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+23:11630:x1875736489197184:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 16587us (16942us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1788842009.611880:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 230 00000020:00080000:3.0:1788842009.611889:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788842009.612612:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788842009.612618:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788842009.614922:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788842009.614943:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788842009.616020:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842009.616269:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489197440 00000100:00100000:1.0:1788842009.616285:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489197440 00000100:00100000:1.0:1788842009.616364:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 61 00000100:00100000:1.0:1788842009.616380:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+23:11629:x1875736489197440:12345-192.168.204.55@tcp:49:lfs.0 00000100:00100000:1.0:1788842009.616572:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+23:11629:x1875736489197440:12345-192.168.204.55@tcp:49:lfs.0 Request processed in 196us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842009.616581:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 61 00000100:00100000:0.0:1788842009.619173:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842009.619353:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489197696 00000100:00100000:1.0:1788842009.619366:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489197696 00000100:00100000:1.0:1788842009.619474:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 62 00000100:00100000:1.0:1788842009.619488:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a658d9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+23:11630:x1875736489197696:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788842009.620463:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788842009.620598:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1788842009.620661:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e800/0x3de1064d33a8c054 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.620683:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e800/0x3de1064d33a8c054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.620698:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e800/0x3de1064d33a8c054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.620749:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e800/0x3de1064d33a8c054 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.620765:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e800/0x3de1064d33a8c054 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.620773:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e800/0x3de1064d33a8c054 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842009.620810:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788842009.620948:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a658d9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+25:11630:x1875736489197696:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 1458us (1784us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1788842009.620958:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 62 00000020:00080000:1.0:1788842009.620966:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788842009.623857:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788842009.623877:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e800/0x3de1064d33a8c054 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.623892:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24e800 already unused, calling callback (ffffffffc1813420) 00010000:00010000:2.0:1788842009.623911:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e800/0x3de1064d33a8c054 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.623923:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e800/0x3de1064d33a8c054 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.623949:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d3a428df500) 00010000:00010000:2.0:1788842009.623952:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788842009.623959:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e800/0x3de1064d33a8c054 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.623965:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e800/0x3de1064d33a8c054 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.623999:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842009.624001:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842009.624003:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788842009.625249:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842009.625355:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489197952 00000100:00100000:0.0:1788842009.625368:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489197952 00000100:00100000:0.0:1788842009.625472:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 231 00000100:00100000:0.0:1788842009.625485:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+25:11629:x1875736489197952:12345-192.168.204.55@tcp:58:lfs.0 00000040:00080000:0.0:1788842009.626084:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788842009.626354:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+25:11629:x1875736489197952:12345-192.168.204.55@tcp:58:lfs.0 Request processed in 867us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842009.626364:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 231 00000100:00100000:0.0:1788842009.651636:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842009.651932:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489198080 00000100:00100000:3.0:1788842009.651946:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489198080 00000100:00100000:3.0:1788842009.652064:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 232 00000100:00100000:3.0:1788842009.652077:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+25:11632:x1875736489198080:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1788842009.652129:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842009.652157:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8c05b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef24af expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.652249:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8c062 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.652267:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8c062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.652281:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8c062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.652299:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8c069 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.652306:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8c069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.652312:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8c069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.652588:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8c070 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.652601:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8bf7b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2470 expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.652612:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8c070 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.652652:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8bf7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2470 expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.652675:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8bf7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2470 expref: 26 pid: 5852 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842009.652692:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7668b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875736500716416:192.168.204.55@tcp:104: 00000100:00100000:3.0:1788842009.652876:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c2240 going to sleep for 11 seconds 00000100:00100000:0.0:1788842009.661361:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842009.663192:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489198336 00000100:00100000:1.0:1788842009.663214:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489198336 00000100:00100000:1.0:1788842009.664184:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 63 00000100:00100000:1.0:1788842009.664209:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+27:5591:x1875736489198336:12345-192.168.204.55@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788842009.666974:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+28:5591:x1875736489198336:12345-192.168.204.55@tcp:35:ldlm_bl.0 Request processed in 2758us (5611us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1788842009.666992:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 63 00000100:00100000:3.0:1788842009.670742:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7668b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875736500716416:192.168.204.55@tcp:104: 00010000:00010000:3.0:1788842009.670797:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8c070 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842009.671339:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842009.671473:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489198464 00000100:00100000:3.0:1788842009.671482:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489198464 00010000:00010000:3.0:1788842009.671536:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8bf7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2470 expref: 28 pid: 5852 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842009.671587:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 85 00000100:00100000:3.0:1788842009.671597:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c255f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+28:2350:x1875736489198464:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788842009.671617:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788842009.671625:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8bf7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2470 expref: 28 pid: 5852 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.671638:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8bf7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2470 expref: 28 pid: 5852 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.671666:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e400/0x3de1064d33a8bf7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2470 expref: 28 pid: 5852 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.671743:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:3.0:1788842009.671759:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8c070 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.671866:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8c070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.671878:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8c070 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842009.671918:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788842009.672218:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c255f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+27:2350:x1875736489198464:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 620us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842009.672228:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 85 00010000:00010000:2.0:1788842009.672416:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8c070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.672428:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8c070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788842009.672493:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788842009.672501:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788842009.672537:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8c070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.672560:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8c070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.672575:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8c062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.672582:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8c062 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.672593:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8c062 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.672599:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053e00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842009.672607:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8c062 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.672616:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8c062 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.672634:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:2.0:1788842009.672648:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842009.672656:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8c062 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.672664:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053e00/0x3de1064d33a8c062 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.672690:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8c069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.672700:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8c069 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.672763:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8c069 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.672770:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842009.672781:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8c069 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.672788:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8c069 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.672799:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3a42af4f00) 00010000:00010000:2.0:1788842009.672801:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842009.672805:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8c069 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.672823:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052400/0x3de1064d33a8c069 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.672871:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052800/0x3de1064d33a8c05b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24af expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.672919:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8c070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24af expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842009.672928:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:2.0:1788842009.672934:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788842009.672936:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60052a00, rc 0) 00000100:00100000:2.0:1788842009.673240:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+26:11632:x1875736489198080:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 20907us (21360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842009.673253:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 232 00010000:00010000:0.0:1788842010.498705:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788842010.626067:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788842010.626080:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788842010.626154:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788842010.626162:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788842010.626343:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76819180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11681:1875736500716544:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788842010.626564:0:11681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a6827eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788842010.628898:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76819180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11681:1875736500716544:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788842010.630087:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842010.630168:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489198592 00000100:00100000:3.0:1788842010.630179:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489198592 00000100:00100000:3.0:1788842010.631283:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 233 00000100:00100000:3.0:1788842010.631300:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+26:11643:x1875736489198592:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788842010.631346:0:5850:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788842010.631518:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+26:11643:x1875736489198592:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 Request processed in 222us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842010.631526:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 233 00000100:00100000:1.0:1788842010.641469:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842010.641554:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489198848 00000100:00100000:0.0:1788842010.641568:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489198848 00000100:00100000:0.0:1788842010.641647:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 234 00000100:00100000:0.0:1788842010.641660:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+26:11643:x1875736489198848:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788842010.641687:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842010.641750:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8c077 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef24b6 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842010.641907:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8c07e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842010.641926:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8c07e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842010.641939:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8c07e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788842010.641952:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788842010.642125:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8c077 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24b6 expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842010.642179:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8c07e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24b6 expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842010.642189:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:0.0:1788842010.642193:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788842010.642197:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78f200, rc 0) 00000100:00100000:0.0:1788842010.642281:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+28:11643:x1875736489198848:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 623us (829us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788842010.642289:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 234 00000100:00100000:0.0:1788842010.661281:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842010.661342:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842010.661451:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489199232 00000100:00100000:3.0:1788842010.661464:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489199232 00000100:00100000:3.0:1788842010.661537:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 235 00000100:00100000:3.0:1788842010.661565:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+28:11643:x1875736489199232:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788842010.661665:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8c08c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842010.661688:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8c08c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842010.661990:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8c08c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842010.662243:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8c08c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842010.662252:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8c08c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842010.662260:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8c08c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842010.662267:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842010.662272:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8c08c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842010.662281:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8c08c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842010.662297:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:3.0:1788842010.662300:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788842010.662307:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8c08c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842010.662313:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60053800/0x3de1064d33a8c08c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842010.662513:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+29:11643:x1875736489199232:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 948us (1167us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788842010.662524:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 235 00000100:00100000:2.0:1788842010.663030:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489198976 00000100:00100000:2.0:1788842010.663039:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489198976 00000100:00100000:2.0:1788842010.663099:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 18 00000100:00100000:2.0:1788842010.663110:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4ec1a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+29:2349:x1875736489198976:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788842010.663124:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788842010.663145:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f200/0x3de1064d33a8c07e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24b6 expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842010.663168:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:2.0:1788842010.663172:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788842010.663210:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4ec1a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+28:2349:x1875736489198976:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 101us (1946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842010.663217:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 18 00000040:00080000:0.0:1788842010.665004:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788842010.665014:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788842010.665635:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788842010.665648:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788842010.672506:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842010.672786:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489199488 00000100:00100000:1.0:1788842010.672801:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489199488 00000100:00100000:1.0:1788842010.672909:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 64 00000100:00100000:1.0:1788842010.672922:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+28:11643:x1875736489199488:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788842010.701175:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+29:11643:x1875736489199488:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 28228us (28657us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788842010.701195:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 64 00000040:00080000:3.0:1788842010.952861:0:12554:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788842010.952884:0:12554:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788842010.952942:0:12554:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788842010.952949:0:12554:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788842011.266911:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500716672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788842011.267012:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842011.267124:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500716672 00000100:00100000:0.0:1788842011.267133:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500716672 00000100:00100000:0.0:1788842011.267210:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788842011.267221:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7680a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875736500716672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788842011.267272:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788842011.267327:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7680a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875736500716672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842011.267354:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1788842011.267381:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788842011.267437:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500716672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788842011.275616:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842011.275661:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489199744 00000100:00100000:0.0:1788842011.275673:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489199744 00000100:00100000:0.0:1788842011.275779:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 236 00000100:00100000:0.0:1788842011.275793:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+29:11656:x1875736489199744:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1788842011.275825:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842011.275851:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8c093 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef24bd expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842011.275988:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8c09a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842011.276006:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8c09a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842011.276022:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8c09a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788842011.276035:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788842011.276403:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e200/0x3de1064d33a8c093 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24bd expref: 32 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842011.276429:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8c09a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24bd expref: 31 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842011.276452:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:0.0:1788842011.276455:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788842011.276460:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78f600, rc 0) 00000100:00100000:0.0:1788842011.276531:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+31:11656:x1875736489199744:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 742us (932us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788842011.276539:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 236 00000100:00080000:0.0:1788842011.276684:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788842011.282118:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842011.282180:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489199872 00000100:00100000:1.0:1788842011.282194:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489199872 00000100:00100000:1.0:1788842011.282259:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 237 00000100:00100000:1.0:1788842011.282272:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7681a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+31:11656:x1875736489199872:12345-192.168.204.55@tcp:54:lfs.0 00010000:00010000:1.0:1788842011.282367:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c0a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842011.282390:0:6963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c0a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842011.282404:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c0a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842011.282440:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c0a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842011.282448:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c0a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842011.282457:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c0a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842011.282464:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24f400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788842011.282469:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c0a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842011.282487:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c0a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842011.282502:0:6963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:1.0:1788842011.282505:0:6963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788842011.282524:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c0a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842011.282531:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c0a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842011.282626:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7681a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+31:11656:x1875736489199872:12345-192.168.204.55@tcp:54:lfs.0 Request processed in 356us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842011.282635:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 237 00000100:00100000:0.0:1788842011.405157:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842011.405267:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489200000 00000100:00100000:1.0:1788842011.405280:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489200000 00000100:00100000:1.0:1788842011.405377:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 71 00000100:00100000:1.0:1788842011.405391:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2352:x1875736489200000:12345-192.168.204.55@tcp:101:cat.0 00010000:00010000:1.0:1788842011.405415:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788842011.405442:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001699b75e/0x3de1064d33a8c0af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef24c4 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788842011.405475:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9f9017, atime: 0x6a9f9017, ctime: 0x6a9f9017, blocks: 0xb 00010000:00010000:1.0:1788842011.405500:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=339s v=(0 0) 00010000:00010000:1.0:1788842011.405505:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842011.405516:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001699b75e/0x3de1064d33a8c0af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24c4 expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842011.405561:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001699b75e/0x3de1064d33a8c0af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24c4 expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842011.405578:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c24f400, rc 0) 00000100:00100000:1.0:1788842011.405658:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:2352:x1875736489200000:12345-192.168.204.55@tcp:101:cat.0 Request processed in 270us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842011.405666:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 71 00000100:00080000:0.0:1788842011.406198:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788842011.411181:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842011.411333:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489200128 00000100:00100000:3.0:1788842011.411348:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489200128 00002000:00100000:3.0:1788842011.411419:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8d3a47d42d80 x1875736489200128/t0(0) o3->090c7b3c-cdb1-4c0e-9553-671552ee3fa2@192.168.204.55@tcp:137/0 lens 488/0 e 0 to 0 dl 1788842022 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788842011.411432:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3a47d42d80 with x1875736489200128 ext(0->4095) 00002000:00010000:3.0:1788842011.411439:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d3a47d42d80 00000100:00100000:3.0:1788842011.411483:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:3.0:1788842011.411494:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:2352:x1875736489200128:12345-192.168.204.55@tcp:3:cat.0 00000100:00100000:3.0:1788842011.411822:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+8:2352:x1875736489200128:12345-192.168.204.55@tcp:3:cat.0 Request processed in 330us (655us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788842011.411832:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 7 00002000:00100000:3.0:1788842011.411840:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8d3a47d42d80 x1875736489200128/t0(0) o3->090c7b3c-cdb1-4c0e-9553-671552ee3fa2@192.168.204.55@tcp:137/0 lens 488/4536 e 0 to 0 dl 1788842022 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788842011.411848:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3a47d42d80 with x1875736489200128 ext(0->4095) 00002000:00010000:3.0:1788842011.411852:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d3a47d42d80 00010000:00010000:0.0:1788842011.523534:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788842011.557099:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842011.557166:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842011.557204:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842011.557390:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489200384 00000100:00100000:0.0:1788842011.557405:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489200384 00000100:00100000:0.0:1788842011.557509:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 97 00000100:00100000:0.0:1788842011.557524:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2352:x1875736489200384:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788842011.557638:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2352:x1875736489200384:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 118us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842011.557647:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 97 00000100:00080000:1.0:1788842011.558073:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788842011.558142:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489200512 00000100:00100000:3.0:1788842011.558149:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489200512 00000100:00100000:3.0:1788842011.558225:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 167 00000100:00100000:3.0:1788842011.558235:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2352:x1875736489200512:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788842011.558280:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2352:x1875736489200512:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 47us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842011.558287:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 167 00000100:00100000:2.0:1788842011.558372:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489200256 00000100:00100000:2.0:1788842011.558377:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489200256 00000100:00100000:2.0:1788842011.558421:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 301 00000100:00100000:2.0:1788842011.558443:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2352:x1875736489200256:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788842011.558474:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2352:x1875736489200256:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 35us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842011.558481:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 301 00000100:00080000:1.0:1788842011.559065:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788842012.546605:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842013.570072:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788842013.762197:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788842013.762211:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788842013.762252:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788842013.762262:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788842013.826052:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500716800:0@lo:400:kworker.0 00000100:00100000:0.0:1788842013.826185:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842013.826186:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500716928:0@lo:400:kworker.0 00000100:00100000:1.0:1788842013.826274:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842013.826318:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500717440:0@lo:400:kworker.0 00000100:00100000:0.0:1788842013.826321:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875736500717312:0@lo:400:kworker.0 00000100:00100000:1.0:1788842013.826350:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842013.826393:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788842013.826404:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500717056:0@lo:400:kworker.0 00000100:00100000:1.0:1788842013.826445:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500717440 00000100:00100000:1.0:1788842013.826452:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500717440 00000100:00100000:1.0:1788842013.826517:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788842013.826527:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875736500717440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788842013.826568:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842013.826584:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875736500717440:12345-0@lo:400:kworker.0 Request processed in 57us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842013.826610:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788842013.826612:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788842013.826623:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500717184:0@lo:400:kworker.0 00000100:00080000:1.0:1788842013.826641:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788842013.826657:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500716928 00000100:00100000:1.0:1788842013.826661:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500716928 00000100:00100000:1.0:1788842013.826686:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500717312 00000100:00100000:1.0:1788842013.826689:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500717312 00000100:00100000:1.0:1788842013.826752:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788842013.826759:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500716928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788842013.826797:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500716928:12345-0@lo:400:kworker.0 Request processed in 39us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842013.826803:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788842013.826828:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788842013.826837:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875736500717312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788842013.826887:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842013.826897:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875736500717312:12345-0@lo:400:kworker.0 Request processed in 59us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842013.826906:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:1.0:1788842013.826942:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788842013.826952:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875736500717312:0@lo:400:kworker.0 00000100:00100000:1.0:1788842013.826965:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842013.827015:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500717056 00000100:00100000:1.0:1788842013.827022:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500716928:0@lo:400:kworker.0 00000100:00100000:0.0:1788842013.827023:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500717056 00000100:00100000:1.0:1788842013.827044:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500717440:0@lo:400:kworker.0 00000100:00100000:1.0:1788842013.827110:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788842013.827205:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500717184 00000100:00100000:3.0:1788842013.827213:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500717184 00000100:00100000:2.0:1788842013.827221:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500716800 00000100:00100000:2.0:1788842013.827228:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500716800 00000100:00100000:3.0:1788842013.827263:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788842013.827278:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a47d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1875736500717184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788842013.827286:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788842013.827298:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3310:x1875736500716800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788842013.827360:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3310:x1875736500716800:12345-0@lo:400:kworker.0 Request processed in 65us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842013.827367:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788842013.827376:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a47d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1875736500717184:12345-0@lo:400:kworker.0 Request processed in 100us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842013.827385:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1788842013.827427:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788842013.827429:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500717184:0@lo:400:kworker.0 00000100:00080000:3.0:1788842013.827433:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788842013.827442:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500716800:0@lo:400:kworker.0 00000100:00100000:1.0:1788842013.827528:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500717056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788842013.827583:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500717056:12345-0@lo:400:kworker.0 Request processed in 464us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842013.827638:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500717056:0@lo:400:kworker.0 00000100:00100000:1.0:1788842013.830847:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788842014.338087:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788842014.338118:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500717568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788842014.338201:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842014.338418:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500717568 00000100:00100000:2.0:1788842014.338426:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500717568 00000100:00100000:2.0:1788842014.338486:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788842014.338497:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875736500717568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788842014.338532:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788842014.338592:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875736500717568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842014.338599:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788842014.343101:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500717568:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788842014.461857:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:1.0:1788842014.594416:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788842014.963217:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1788842014.963260:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1788842014.963326:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d3a50cfbd80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788842014.963332:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d3a4e1be000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d3a50cfb300 00000020:00080000:2.0:1788842014.963337:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d3a4e1be100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d3a7c7be400 00000020:00080000:0.0:1788842014.965259:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788842014.967178:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1788842014.971124:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:1.0:1788842014.971153:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1788842014.971165:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00010000:00010000:0.0:1788842015.617972:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788842016.393212:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500717696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788842016.393314:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842016.393434:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500717696 00000100:00100000:1.0:1788842016.393446:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500717696 00000100:00100000:1.0:1788842016.393531:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788842016.393543:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500717696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788842016.393592:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788842016.393647:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500717696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842016.393655:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788842016.393683:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788842016.393742:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1788842016.395167:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d3a4926e300, transno 4294967322 00000004:00080000:1.0:1788842016.395195:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1788842016.395245:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500717696:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788842016.648918:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788842016.691539:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842016.691608:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842016.691660:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842016.691692:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842016.691768:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842016.691807:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489201152 00000100:00100000:1.0:1788842016.691819:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489201152 00000100:00100000:1.0:1788842016.691892:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489200768 00000100:00100000:1.0:1788842016.691895:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489200768 00000100:00100000:1.0:1788842016.691940:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 171 00000100:00100000:1.0:1788842016.691952:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489201152:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788842016.692060:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2350:x1875736489201152:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 110us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842016.692069:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 171 00000100:00100000:1.0:1788842016.692090:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 172 00000100:00100000:1.0:1788842016.692096:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+18:2350:x1875736489200768:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788842016.692127:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+18:2350:x1875736489200768:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 31us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842016.692135:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 172 00000100:00100000:1.0:1788842016.692162:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489200896 00000100:00100000:1.0:1788842016.692166:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489200896 00000100:00100000:1.0:1788842016.692198:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489201024 00000100:00100000:1.0:1788842016.692201:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489201024 00000100:00100000:1.0:1788842016.692224:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 100 00000100:00100000:1.0:1788842016.692232:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2350:x1875736489200896:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788842016.692263:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2350:x1875736489200896:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 33us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842016.692270:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 100 00000100:00100000:1.0:1788842016.692281:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 101 00000100:00100000:1.0:1788842016.692287:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2350:x1875736489201024:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788842016.692312:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2350:x1875736489201024:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 26us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842016.692320:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 101 00000100:00080000:1.0:1788842016.692337:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788842016.692349:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788842016.692352:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788842016.692885:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489200640 00000100:00100000:0.0:1788842016.692893:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489200640 00000100:00100000:0.0:1788842016.692938:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 303 00000100:00100000:0.0:1788842016.692947:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2350:x1875736489200640:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788842016.692993:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2350:x1875736489200640:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 48us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842016.693000:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 303 00000100:00100000:3.0:1788842016.747739:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842016.747937:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489201280 00000100:00100000:0.0:1788842016.747952:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489201280 00000100:00100000:0.0:1788842016.748155:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 238 00000100:00100000:0.0:1788842016.748169:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7668b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+18:11309:x1875736489201280:12345-192.168.204.55@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788842016.748334:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7668b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+18:11309:x1875736489201280:12345-192.168.204.55@tcp:60:lhsmtool_posix.0 Request processed in 168us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842016.748343:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 238 00000100:00100000:0.0:1788842016.754969:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842016.755131:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489201536 00000100:00100000:3.0:1788842016.755146:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489201536 00000100:00100000:3.0:1788842016.755224:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 65 00000100:00100000:3.0:1788842016.755239:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+18:11309:x1875736489201536:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788842016.757561:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+19:11309:x1875736489201536:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 2310us (2592us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788842016.757580:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 65 00000100:00100000:3.0:1788842016.951690:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842016.951832:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489201664 00000100:00100000:1.0:1788842016.951843:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489201664 00000100:00100000:1.0:1788842016.951908:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 239 00000100:00100000:1.0:1788842016.951920:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7668aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:12108:x1875736489201664:12345-192.168.204.55@tcp:101:lsof.0 00010000:00010000:1.0:1788842016.951944:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788842016.951969:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8c0b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef24cb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842016.952057:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24fa00/0x3de1064d33a8c0bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842016.952072:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24fa00/0x3de1064d33a8c0bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842016.952085:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24fa00/0x3de1064d33a8c0bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788842016.952122:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788842016.952126:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788842016.952155:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24fa00/0x3de1064d33a8c0bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842016.952181:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8c0b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24cb expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842016.952199:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24fa00/0x3de1064d33a8c0bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24cb expref: 6 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842016.952208:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a821d0300) 00010000:00010000:1.0:1788842016.952219:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788842016.952224:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c24fa00, rc 0) 00000100:00100000:1.0:1788842016.952300:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7668aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:419331f1-87f8-40c5-a1c8-5f66078f5ec5+6:12108:x1875736489201664:12345-192.168.204.55@tcp:101:lsof.0 Request processed in 383us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842016.952308:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 239 00010000:00010000:2.0:1788842017.666027:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842018.691098:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788842018.947781:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875736500718080:0@lo:400:kworker.0 00000100:00100000:0.0:1788842018.947868:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842018.947945:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788842018.947952:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875736500717952:0@lo:400:kworker.0 00000100:00100000:0.0:1788842018.947978:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842018.947997:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500718464:0@lo:400:kworker.0 00000100:00100000:0.0:1788842018.948023:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842018.948066:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500718080 00000100:00100000:0.0:1788842018.948074:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500718080 00000100:00100000:0.0:1788842018.948128:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500717952 00000100:00100000:0.0:1788842018.948131:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500717952 00000100:00100000:0.0:1788842018.948155:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788842018.948164:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875736500718080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788842018.948218:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875736500718080:12345-0@lo:400:kworker.0 Request processed in 55us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842018.948225:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788842018.948242:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788842018.948248:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875736500717952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788842018.948277:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875736500717952:12345-0@lo:400:kworker.0 Request processed in 29us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842018.948283:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788842018.948321:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500718464 00000100:00100000:0.0:1788842018.948325:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500718464 00000100:00100000:0.0:1788842018.948354:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788842018.948361:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500718464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788842018.948395:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500718464:12345-0@lo:400:kworker.0 Request processed in 35us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842018.948402:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1788842018.948418:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788842018.948422:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788842018.948456:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875736500717952:0@lo:400:kworker.0 00000100:00100000:0.0:1788842018.948466:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788842018.948472:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d3a75cd7b80, transno 4294967310 00000100:00100000:0.0:1788842018.948483:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500718464:0@lo:400:kworker.0 00000100:00100000:0.0:1788842018.948494:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875736500718080:0@lo:400:kworker.0 00000100:00100000:1.0:1788842018.949003:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a4926e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500717824:0@lo:400:kworker.0 00000100:00100000:1.0:1788842018.949043:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842018.949080:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875736500718336:0@lo:400:kworker.0 00000100:00100000:1.0:1788842018.949117:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842018.949146:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788842018.949152:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500718208:0@lo:400:kworker.0 00000100:00100000:1.0:1788842018.949176:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842018.949206:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500718208 00000100:00100000:1.0:1788842018.949211:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500718208 00000100:00100000:1.0:1788842018.949247:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788842018.949254:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a412aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500718208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788842018.949292:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a412aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500718208:12345-0@lo:400:kworker.0 Request processed in 39us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842018.949299:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1788842018.949318:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788842018.949335:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500718208:0@lo:400:kworker.0 00000100:00100000:1.0:1788842018.949354:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500718336 00000100:00100000:1.0:1788842018.949356:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500718336 00000100:00100000:1.0:1788842018.949382:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788842018.949388:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a412ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875736500718336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788842018.949434:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a412ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875736500718336:12345-0@lo:400:kworker.0 Request processed in 46us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842018.949440:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:1.0:1788842018.949453:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788842018.949468:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875736500718336:0@lo:400:kworker.0 00000100:00100000:3.0:1788842018.949538:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500717824 00000100:00100000:3.0:1788842018.949543:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500717824 00000100:00100000:3.0:1788842018.949579:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788842018.949587:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3310:x1875736500717824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788842018.949636:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3310:x1875736500717824:12345-0@lo:400:kworker.0 Request processed in 49us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842018.949643:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788842018.949675:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a4926e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500717824:0@lo:400:kworker.0 00000100:00100000:3.0:1788842019.458170:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788842019.458195:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500718592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788842019.458269:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842019.458398:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500718592 00000100:00100000:0.0:1788842019.458406:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500718592 00000100:00100000:0.0:1788842019.458458:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788842019.458483:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4926e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500718592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788842019.458519:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788842019.458567:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4926e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500718592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842019.458574:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788842019.459751:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500718592:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788842019.714287:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788842020.012808:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:2.0:1788842020.012840:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1788842020.012940:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788842020.012955:0:5884:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:02000400:1.0:1788842020.213166:0:12759:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 00:33:37 (1788842017) 00010000:00010000:0.0:1788842020.738084:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788842021.506178:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788842021.506201:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500718720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788842021.506293:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842021.506414:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500718720 00000100:00100000:0.0:1788842021.506423:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500718720 00000100:00100000:0.0:1788842021.508550:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788842021.508566:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500718720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788842021.508602:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788842021.508701:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500718720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (2409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842021.508721:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788842021.508775:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500718720:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788842021.509067:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788842021.767319:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788842021.796216:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842021.796387:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842021.796588:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489201792 00000100:00100000:1.0:1788842021.796599:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489201792 00000100:00100000:1.0:1788842021.796655:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 305 00000100:00100000:1.0:1788842021.796675:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2349:x1875736489201792:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788842021.796775:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2349:x1875736489201792:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 96us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842021.796783:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 305 00000100:00100000:3.0:1788842021.797363:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842021.797388:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842021.797412:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842021.799430:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489202304 00000100:00100000:2.0:1788842021.799444:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489202304 00000100:00100000:2.0:1788842021.799524:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489201920 00000100:00100000:2.0:1788842021.799527:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489201920 00000100:00100000:2.0:1788842021.799564:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 176 00000100:00100000:2.0:1788842021.799581:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+6:2349:x1875736489202304:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788842021.799870:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 177 00000100:00100000:1.0:1788842021.799887:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+18:2349:x1875736489201920:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788842021.799978:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+18:2349:x1875736489201920:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 100us (2588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842021.799985:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 177 00000100:00080000:1.0:1788842021.800007:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788842021.800295:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+6:2349:x1875736489202304:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 716us (2932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842021.800302:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 176 00000100:00100000:0.0:1788842021.813391:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489202048 00000100:00100000:0.0:1788842021.813418:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489202048 00000100:00100000:0.0:1788842021.813525:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489202176 00000100:00100000:0.0:1788842021.813529:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489202176 00000100:00100000:0.0:1788842021.813566:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 104 00000100:00100000:0.0:1788842021.813578:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2349:x1875736489202048:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788842021.813685:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2349:x1875736489202048:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 109us (17298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842021.813695:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 104 00000100:00100000:3.0:1788842021.815185:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 105 00000100:00100000:3.0:1788842021.815209:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2349:x1875736489202176:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788842021.815300:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2349:x1875736489202176:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 101us (17886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842021.817139:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 105 00000100:00080000:2.0:1788842021.817807:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788842021.817817:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788842022.786184:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842023.810380:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788842024.002815:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788842024.002825:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788842024.003576:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1788842024.003589:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788842024.066289:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500718976:0@lo:400:kworker.0 00000100:00100000:2.0:1788842024.066364:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500719232:0@lo:400:kworker.0 00000100:00100000:0.0:1788842024.066367:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842024.066411:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842024.066443:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500719488:0@lo:400:kworker.0 00000100:00100000:2.0:1788842024.066456:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788842024.066465:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500718848:0@lo:400:kworker.0 00000100:00100000:0.0:1788842024.066484:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842024.066506:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842024.066511:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788842024.066519:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500719104:0@lo:400:kworker.0 00000100:00100000:2.0:1788842024.066536:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875736500719360:0@lo:400:kworker.0 00000100:00100000:0.0:1788842024.066548:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842024.066570:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842024.066603:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500719232 00000100:00100000:0.0:1788842024.066611:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500719232 00000100:00100000:1.0:1788842024.066682:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500718848 00000100:00100000:1.0:1788842024.066688:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500718848 00000100:00100000:0.0:1788842024.066698:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500719488 00000100:00100000:0.0:1788842024.066704:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500719488 00000100:00100000:1.0:1788842024.066748:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788842024.066754:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788842024.066767:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500719232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788842024.066771:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49927850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3309:x1875736500718848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788842024.066824:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49927850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3309:x1875736500718848:12345-0@lo:400:kworker.0 Request processed in 57us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842024.066834:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788842024.066835:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500719232:12345-0@lo:400:kworker.0 Request processed in 68us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842024.066845:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788842024.066862:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788842024.066869:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500719488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788842024.066876:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500718976 00000100:00100000:1.0:1788842024.066881:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500718976 00000100:00100000:1.0:1788842024.066909:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788842024.066909:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500719488:12345-0@lo:400:kworker.0 Request processed in 40us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842024.066922:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788842024.066924:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500718976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788842024.066975:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500718976:12345-0@lo:400:kworker.0 Request processed in 55us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842024.066976:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500719488:0@lo:400:kworker.0 00000100:00100000:1.0:1788842024.066989:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788842024.067002:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500719104 00000100:00100000:1.0:1788842024.067006:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500719104 00000100:00100000:0.0:1788842024.067017:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500718976:0@lo:400:kworker.0 00000100:00100000:1.0:1788842024.067028:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500719360 00000100:00100000:1.0:1788842024.067033:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500719360 00000100:00100000:1.0:1788842024.067055:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788842024.067064:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788842024.067065:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500719104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788842024.067079:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875736500719360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788842024.067112:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500719104:12345-0@lo:400:kworker.0 Request processed in 50us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842024.067123:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788842024.067124:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875736500719360:12345-0@lo:400:kworker.0 Request processed in 48us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842024.067133:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788842024.067163:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500719104:0@lo:400:kworker.0 00000100:00080000:2.0:1788842024.067231:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788842024.067242:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788842024.067244:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788842024.067270:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500718848:0@lo:400:kworker.0 00000100:00100000:2.0:1788842024.067281:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875736500719360:0@lo:400:kworker.0 00000100:00100000:2.0:1788842024.067290:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500719232:0@lo:400:kworker.0 00000100:00100000:3.0:1788842024.453837:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842024.467558:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489202560 00000100:00100000:0.0:1788842024.467577:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489202560 00000100:00080000:1.0:1788842024.467658:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788842024.467692:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 66 00000100:00100000:0.0:1788842024.467705:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+18:12329:x1875736489202560:12345-192.168.204.55@tcp:35:umount.0 00000100:00100000:1.0:1788842024.468217:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+19:12329:x1875736489202560:12345-192.168.204.55@tcp:35:umount.0 Request processed in 511us (14386us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788842024.468226:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 66 00000100:00100000:3.0:1788842024.475277:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842024.475449:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489202816 00000100:00100000:0.0:1788842024.475459:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489202816 00000100:00100000:0.0:1788842024.475529:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 67 00000100:00100000:0.0:1788842024.475539:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+19:12329:x1875736489202816:12345-192.168.204.55@tcp:35:umount.0 00000100:00100000:2.0:1788842024.476089:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+20:12329:x1875736489202816:12345-192.168.204.55@tcp:35:umount.0 Request processed in 549us (821us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788842024.476098:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 67 00000100:00100000:3.0:1788842024.481758:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842024.481867:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489203072 00000100:00100000:1.0:1788842024.481889:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489203072 00000100:00100000:1.0:1788842024.481957:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 68 00000100:00100000:1.0:1788842024.481968:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a658db450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+20:12329:x1875736489203072:12345-192.168.204.55@tcp:35:umount.0 00000100:00100000:1.0:1788842024.482203:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a658db450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+21:12329:x1875736489203072:12345-192.168.204.55@tcp:35:umount.0 Request processed in 235us (493us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788842024.482210:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 68 00000100:00100000:3.0:1788842024.485770:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842024.485927:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489203328 00000100:00100000:1.0:1788842024.485948:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489203328 00000100:00100000:1.0:1788842024.486007:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 69 00000100:00100000:1.0:1788842024.486017:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+21:12329:x1875736489203328:12345-192.168.204.55@tcp:35:umount.0 00000100:00100000:1.0:1788842024.486352:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+22:12329:x1875736489203328:12345-192.168.204.55@tcp:35:umount.0 Request processed in 336us (592us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788842024.486361:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 69 00000100:00100000:3.0:1788842024.494633:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842024.494669:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842024.494698:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842024.494818:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842024.495197:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489203584 00000100:00100000:1.0:1788842024.495206:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489203584 00000100:00100000:1.0:1788842024.495260:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489203456 00000100:00100000:1.0:1788842024.495264:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489203456 00000100:00100000:1.0:1788842024.495277:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489203712 00000100:00100000:1.0:1788842024.495279:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489203712 00000100:00100000:1.0:1788842024.495295:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 19 00000100:00100000:1.0:1788842024.495304:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51360ac4-5eeb-41b7-beab-1dfd58163005+15:2352:x1875736489203584:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788842024.495321:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788842024.495340:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a82044200/0x3de1064d33a8b09b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef201e expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842024.495358:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788842024.495421:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51360ac4-5eeb-41b7-beab-1dfd58163005+14:2352:x1875736489203584:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 117us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842024.495443:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 19 00000100:00100000:1.0:1788842024.495461:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 20 00000100:00100000:1.0:1788842024.495467:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51360ac4-5eeb-41b7-beab-1dfd58163005+13:2352:x1875736489203456:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788842024.495476:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788842024.495485:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a43530200/0x3de1064d33a8b135 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2056 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842024.495494:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788842024.495513:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51360ac4-5eeb-41b7-beab-1dfd58163005+12:2352:x1875736489203456:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 46us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842024.495519:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 20 00000100:00100000:1.0:1788842024.495532:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00100000:1.0:1788842024.495539:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51360ac4-5eeb-41b7-beab-1dfd58163005+11:2350:x1875736489203712:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788842024.495550:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788842024.495558:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a7c6cc600/0x3de1064d33a8b31f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2121 expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842024.495567:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788842024.495588:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51360ac4-5eeb-41b7-beab-1dfd58163005+10:2350:x1875736489203712:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 50us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842024.495594:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00100000:0.0:1788842024.496040:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489203840 00000100:00100000:0.0:1788842024.496045:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489203840 00000100:00100000:0.0:1788842024.496097:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 72 00000100:00100000:0.0:1788842024.496104:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2348:x1875736489203840:12345-192.168.204.55@tcp:9:umount.0 00000020:00000080:0.0:1788842024.496128:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8b40d 00000100:00080000:0.0:1788842024.496135:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8d3a7f1ff800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788842024.496171:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788842024.496423:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+2:2348:x1875736489203840:12345-192.168.204.55@tcp:9:umount.0 Request processed in 318us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842024.496430:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 72 00010000:00010000:0.0:1788842024.496448:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788842024.496873:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788842024.502202:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842024.502350:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489204224 00000100:00100000:0.0:1788842024.502360:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489204224 00000100:00100000:0.0:1788842024.502507:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 73 00000100:00100000:0.0:1788842024.502518:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+7:2348:x1875736489204224:12345-192.168.204.55@tcp:9:umount.0 00000020:00000080:0.0:1788842024.502560:0:6695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8b66e 00000020:00010000:0.0:1788842024.502566:0:6695:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d3a768a9800: total 0 00000100:00080000:0.0:1788842024.502571:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8d3a768ae800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788842024.502685:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:1.0:1788842024.504252:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788842024.505176:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+5:2348:x1875736489204224:12345-192.168.204.55@tcp:9:umount.0 Request processed in 2653us (2977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842024.505188:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 73 00000020:00010000:2.0:1788842024.514225:0:8447:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d3a768a9800: total 0 00010000:00010000:2.0:1788842024.514307:0:8447:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d3a768a9800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788842024.514376:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001699b75e/0x3de1064d33a8c0af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24c4 expref: 4 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842024.514425:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfa3eb35/0x3de1064d33a8ba11 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22f6 expref: 3 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842024.514440:0:8447:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d3a768a9800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788842024.514452:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842024.514454:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842024.514456:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788842024.518932:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842024.519163:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489205248 00000100:00100000:1.0:1788842024.519174:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489205248 00000100:00100000:1.0:1788842024.519281:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 240 00000100:00100000:1.0:1788842024.519293:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+22:2348:x1875736489205248:12345-192.168.204.55@tcp:39:umount.0 00000020:00000080:1.0:1788842024.519325:0:5851:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8b0a9 00000020:00010000:1.0:1788842024.519342:0:5851:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d3a75ee3800: total 0 00000100:00080000:1.0:1788842024.519347:0:5851:0:(import.c:65:import_set_state_nolock()) ffff8d3a486f4000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788842024.519376:0:5851:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:1.0:1788842024.519802:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:090c7b3c-cdb1-4c0e-9553-671552ee3fa2+21:2348:x1875736489205248:12345-192.168.204.55@tcp:39:umount.0 Request processed in 510us (879us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788842024.519811:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 240 00000020:00010000:2.0:1788842024.520779:0:8448:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d3a75ee3800: total 0 00010000:00010000:2.0:1788842024.520827:0:8448:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d3a75ee3800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788842024.520861:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:2.0:1788842024.520865:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788842024.520875:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531800/0x3de1064d33a8ba8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2319 expref: 20 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842024.520914:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:2.0:1788842024.520917:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788842024.520921:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78ea00/0x3de1064d33a8b8f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22a9 expref: 19 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842024.520943:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:2.0:1788842024.520946:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788842024.520950:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030800/0x3de1064d33a8b3e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef214b expref: 18 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842024.520964:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:2.0:1788842024.520966:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788842024.520970:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f800/0x3de1064d33a8bf90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2477 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842024.520988:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d3a428df000) 00010000:00010000:2.0:1788842024.520990:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842024.520993:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43531000/0x3de1064d33a8b38f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2136 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842024.521011:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:2.0:1788842024.521013:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788842024.521017:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8b9fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22ef expref: 15 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842024.521028:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:2.0:1788842024.521031:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788842024.521041:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052a00/0x3de1064d33a8c070 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24af expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842024.521056:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a821d0300) 00010000:00010000:2.0:1788842024.521058:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788842024.521062:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a43530400/0x3de1064d33a8ba73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2312 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842024.521072:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3a61283f00) 00010000:00010000:2.0:1788842024.521074:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788842024.521077:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78f600/0x3de1064d33a8c09a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24bd expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842024.521091:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3a4e719100) 00010000:00010000:2.0:1788842024.521094:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788842024.521097:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8b9d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef22e1 expref: 11 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842024.521112:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3a821d0600) 00010000:00010000:2.0:1788842024.521115:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788842024.521118:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c78e800/0x3de1064d33a8bd6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef23eb expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842024.521133:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d3a821d0d00) 00010000:00010000:2.0:1788842024.521135:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788842024.521138:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a60052000/0x3de1064d33a8b6d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef221d expref: 9 pid: 8623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842024.521151:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d3a821d0700) 00010000:00010000:2.0:1788842024.521158:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788842024.521162:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031e00/0x3de1064d33a8b373 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef212f expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842024.521177:0:8448:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d3a75ee3800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788842024.521189:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842024.521191:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842024.521192:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788842024.578276:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788842024.578298:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500719616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788842024.578366:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842024.578487:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500719616 00000100:00100000:2.0:1788842024.578495:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500719616 00000100:00100000:2.0:1788842024.578557:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788842024.578570:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500719616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788842024.578604:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788842024.578661:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500719616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842024.578667:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788842024.579066:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500719616:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788842024.670567:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 090c7b3c-cdb1-4c0e-9553-671552ee3fa2 00000020:00000080:1.0:1788842024.670577:0:7641:0:(genops.c:885:class_export_put()) final put ffff8d3a768a9000/090c7b3c-cdb1-4c0e-9553-671552ee3fa2 00000020:00000080:3.0:1788842024.670647:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a768a9000/090c7b3c-cdb1-4c0e-9553-671552ee3fa2 for lustre-OST0001 00000020:00000080:3.0:1788842024.670693:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3a7f1ff800 for lustre-OST0001 00010000:00010000:0.0:1788842024.833952:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788842025.161321:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000001:00100000:2.0:1788842025.161351:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 090c7b3c-cdb1-4c0e-9553-671552ee3fa2 00000001:00080000:2.0:1788842025.161356:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1788842025.161363:0:5873:0:(genops.c:885:class_export_put()) final put ffff8d3a75ee3800/090c7b3c-cdb1-4c0e-9553-671552ee3fa2 00000020:00000080:0.0:1788842025.161726:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a75ee3800/090c7b3c-cdb1-4c0e-9553-671552ee3fa2 for lustre-MDT0000 00000020:00000080:0.0:1788842025.161787:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3a486f4000 for lustre-MDT0000 00000001:00100000:1.0:1788842025.194068:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 090c7b3c-cdb1-4c0e-9553-671552ee3fa2 00000020:00000080:1.0:1788842025.194077:0:6720:0:(genops.c:885:class_export_put()) final put ffff8d3a768a9800/090c7b3c-cdb1-4c0e-9553-671552ee3fa2 00000020:00000080:1.0:1788842025.194102:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a768a9800/090c7b3c-cdb1-4c0e-9553-671552ee3fa2 for lustre-OST0000 00000020:00000080:1.0:1788842025.194144:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3a768ae800 for lustre-OST0000 00010000:00010000:0.0:1788842025.857967:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788842026.626419:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788842026.626447:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500719744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788842026.626526:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842026.626726:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500719744 00000100:00100000:0.0:1788842026.626759:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500719744 00000100:00100000:0.0:1788842026.626835:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788842026.626846:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500719744:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788842026.627030:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788842026.627230:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788842026.627299:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500719744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 455us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842026.627308:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788842026.627400:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500719744:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788842026.882469:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788842026.898807:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842026.898870:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842026.904751:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842026.913851:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842026.913891:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489205888 00000100:00100000:3.0:1788842026.913899:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489205888 00000100:00100000:3.0:1788842026.913962:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 241 00000100:00100000:3.0:1788842026.913986:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+6:2348:x1875736489205888:12345-192.168.204.55@tcp:39:umount.0 00000020:00000080:3.0:1788842026.914025:0:5850:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8b190 00000020:00010000:3.0:1788842026.914033:0:5850:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d3a75de5000: total 0 00000100:00080000:3.0:1788842026.914037:0:5850:0:(import.c:65:import_set_state_nolock()) ffff8d3a75de4800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788842026.914063:0:5850:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1788842026.914540:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:419331f1-87f8-40c5-a1c8-5f66078f5ec5+5:2348:x1875736489205888:12345-192.168.204.55@tcp:39:umount.0 Request processed in 554us (697us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788842026.914550:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 241 00000020:00010000:3.0:1788842026.914590:0:8448:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d3a75de5000: total 0 00010000:00010000:3.0:1788842026.914630:0:8448:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d3a75de5000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788842026.914662:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a821d0300) 00010000:00010000:3.0:1788842026.914666:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788842026.914675:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24fa00/0x3de1064d33a8c0bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24cb expref: 4 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842026.914698:0:8448:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d3a75de5000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788842026.914749:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842026.914752:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842026.914753:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788842026.914910:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788842026.917503:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489205504 00000100:00100000:2.0:1788842026.917520:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489205504 00000100:00100000:2.0:1788842026.917604:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489205376 00000100:00100000:2.0:1788842026.917608:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489205376 00000100:00100000:2.0:1788842026.917623:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489205632 00000100:00100000:2.0:1788842026.917626:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489205632 00000100:00100000:2.0:1788842026.917649:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 22 00000100:00100000:2.0:1788842026.917659:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51360ac4-5eeb-41b7-beab-1dfd58163005+12:2350:x1875736489205504:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788842026.917693:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788842026.917729:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a7c6ccc00/0x3de1064d33a8b182 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2095 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842026.917747:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788842026.917819:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51360ac4-5eeb-41b7-beab-1dfd58163005+11:2350:x1875736489205504:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 161us (19021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842026.917827:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 22 00000100:00100000:2.0:1788842026.917845:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 23 00000100:00100000:2.0:1788842026.917852:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51360ac4-5eeb-41b7-beab-1dfd58163005+10:2349:x1875736489205376:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788842026.917859:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788842026.917868:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a43531a00/0x3de1064d33a8b17b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef206b expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842026.917876:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 24 00010000:00010000:2.0:1788842026.917877:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788842026.917884:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51360ac4-5eeb-41b7-beab-1dfd58163005+9:2351:x1875736489205632:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788842026.917891:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788842026.917895:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51360ac4-5eeb-41b7-beab-1dfd58163005+9:2349:x1875736489205376:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 45us (19026us total) trans 0 rc 0/0 00010000:00010000:3.0:1788842026.917900:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a7c6cde00/0x3de1064d33a8b318 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef211a expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842026.917901:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 23 00010000:00010000:3.0:1788842026.917909:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788842026.917933:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51360ac4-5eeb-41b7-beab-1dfd58163005+7:2351:x1875736489205632:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 51us (13192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842026.917939:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 24 00000100:00100000:3.0:1788842026.959982:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842026.960106:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489206144 00000100:00100000:2.0:1788842026.960116:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489206144 00000100:00100000:2.0:1788842026.960195:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 307 00000100:00100000:2.0:1788842026.960206:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+7:2348:x1875736489206144:12345-192.168.204.55@tcp:251:umount.0 00000020:00000080:2.0:1788842026.960254:0:5845:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8b086 00000020:00010000:2.0:1788842026.960262:0:5845:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d3a4e198000: total 0 00000100:00080000:2.0:1788842026.960281:0:5845:0:(import.c:65:import_set_state_nolock()) ffff8d3a4e198800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788842026.960361:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51360ac4-5eeb-41b7-beab-1dfd58163005+3:2348:x1875736489206144:12345-192.168.204.55@tcp:251:umount.0 Request processed in 157us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842026.960384:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 307 00000020:00010000:0.0:1788842026.960810:0:5838:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d3a4e198000: total 0 00010000:00010000:0.0:1788842026.960815:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842026.960855:0:5838:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d3a4e198000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788842026.960897:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a60052e00/0x3de1064d33a8b13c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef205d expref: 2 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842026.960910:0:5838:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d3a4e198000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788842026.960920:0:5838:0:(genops.c:885:class_export_put()) final put ffff8d3a4e198000/51360ac4-5eeb-41b7-beab-1dfd58163005 00010000:00010000:0.0:1788842026.960943:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842026.960945:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842026.960946:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788842026.961030:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a4e198000/51360ac4-5eeb-41b7-beab-1dfd58163005 for MGS 00000020:00000080:1.0:1788842026.963205:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3a4e198800 for MGS 00010000:00010000:0.0:1788842027.907887:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788842028.731251:0:12960:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788842028.746877:0:12960:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788842028.746936:0:12960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60052c00/0x3de1064d33a8b10b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b112 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842028.746952:0:12960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60052c00/0x3de1064d33a8b10b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b112 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842028.746959:0:12960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60052c00/0x3de1064d33a8b10b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3de1064d33a8b112 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842028.746981:0:12960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.155@tcp lock: ffff8d3a60052c00/0x3de1064d33a8b10b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3de1064d33a8b112 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842028.747013:0:12960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788842028.747020:0:12960:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788842028.747048:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788842028.747055:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788842028.747061:0:12960:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788842028.747090:0:12960:0:(import.c:65:import_set_state_nolock()) ffff8d3a77aec000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788842028.747444:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788842028.747452:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a60052c00/0x3de1064d33a8b10b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x3de1064d33a8b112 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842028.747461:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052c00 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:3.0:1788842028.747465:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a60052c00/0x3de1064d33a8b10b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x3de1064d33a8b112 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842028.747474:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a60052c00/0x3de1064d33a8b10b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x3de1064d33a8b112 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788842028.747481:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a60052c00/0x3de1064d33a8b10b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x3de1064d33a8b112 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788842028.747486:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788842028.747488:0:8447:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788842028.747491:0:8447:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788842028.747519:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a60052c00/0x3de1064d33a8b10b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3de1064d33a8b112 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842028.747536:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788842028.747564:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a60052c00/0x3de1064d33a8b10b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3de1064d33a8b112 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842028.747572:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a60052c00/0x3de1064d33a8b10b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3de1064d33a8b112 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842028.747596:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842028.747598:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842028.747599:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788842028.747603:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500720000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788842028.747674:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842028.748409:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500720000 00000100:00100000:3.0:1788842028.748417:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500720000 00000100:00100000:3.0:1788842028.748481:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788842028.748491:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a4ec18450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3310:x1875736500720000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788842028.748504:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788842028.748521:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a43530600/0x3de1064d33a8b112 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3de1064d33a8b10b expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842028.748545:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788842028.748597:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a4ec18450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:3310:x1875736500720000:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842028.748604:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788842028.748622:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875736500719872:0@lo:39:umount.0 00000100:00100000:0.0:1788842028.748656:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842028.748813:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500719872 00000100:00100000:3.0:1788842028.748818:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500719872 00000100:00100000:3.0:1788842028.748850:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788842028.748857:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875736500719872:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788842028.748879:0:5852:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8ae95 00000100:00080000:3.0:1788842028.748887:0:5852:0:(import.c:65:import_set_state_nolock()) ffff8d3a75dff000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788842028.748939:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3306:x1875736500719872:12345-0@lo:39:umount.0 Request processed in 82us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842028.748939:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd738bcb-4fee-4a21-af92-bab36d5458e2:3310:1875736500720000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788842028.748945:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1788842028.748951:0:5852:0:(genops.c:885:class_export_put()) final put ffff8d3a75dfd000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788842028.748973:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788842028.748992:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8d3a77aec000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788842028.749015:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875736500719872:0@lo:39:umount.0 00000020:00000080:3.0:1788842028.749036:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a75dfd000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:1.0:1788842028.749068:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788842028.749073:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788842028.749077:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788842028.749083:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3a75dff000 for lustre-MDT0000 00010000:00010000:1.0:1788842028.752813:0:12960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60052600/0x3de1064d33a8b119 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b120 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842028.752970:0:12960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60052600/0x3de1064d33a8b119 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b120 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842028.752978:0:12960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60052600/0x3de1064d33a8b119 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x3de1064d33a8b120 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842028.752986:0:12960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.155@tcp lock: ffff8d3a60052600/0x3de1064d33a8b119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x3de1064d33a8b120 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842028.753032:0:12960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788842028.753039:0:12960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43531600/0x3de1064d33a8b040 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b047 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842028.753047:0:12960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43531600/0x3de1064d33a8b040 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b047 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842028.753054:0:12960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43531600/0x3de1064d33a8b040 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3de1064d33a8b047 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842028.753061:0:12960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.155@tcp lock: ffff8d3a43531600/0x3de1064d33a8b040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3de1064d33a8b047 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842028.753077:0:12960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788842028.753084:0:12960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43530a00/0x3de1064d33a8b342 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b349 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842028.753198:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788842028.753207:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a60052600/0x3de1064d33a8b119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x3de1064d33a8b120 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842028.753215:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052600 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:0.0:1788842028.753218:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a60052600/0x3de1064d33a8b119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x3de1064d33a8b120 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842028.753238:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a60052600/0x3de1064d33a8b119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x3de1064d33a8b120 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788842028.753244:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a60052600/0x3de1064d33a8b119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x3de1064d33a8b120 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788842028.753249:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788842028.753252:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788842028.753287:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a60052600/0x3de1064d33a8b119 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3de1064d33a8b120 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842028.753293:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788842028.753317:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a60052600/0x3de1064d33a8b119 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3de1064d33a8b120 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842028.753324:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a60052600/0x3de1064d33a8b119 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3de1064d33a8b120 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842028.753337:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788842028.753340:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a43531600/0x3de1064d33a8b040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3de1064d33a8b047 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842028.753345:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43531600 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:0.0:1788842028.753348:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a43531600/0x3de1064d33a8b040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3de1064d33a8b047 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842028.753355:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a43531600/0x3de1064d33a8b040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3de1064d33a8b047 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788842028.753361:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a43531600/0x3de1064d33a8b040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3de1064d33a8b047 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788842028.753372:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788842028.753375:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788842028.753377:0:5839:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788842028.753410:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a43531600/0x3de1064d33a8b040 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3de1064d33a8b047 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842028.753417:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788842028.753423:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a43531600/0x3de1064d33a8b040 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3de1064d33a8b047 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842028.753429:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a43531600/0x3de1064d33a8b040 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3de1064d33a8b047 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842028.753443:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842028.753445:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842028.753447:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842028.753611:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842028.753640:0:12960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43530a00/0x3de1064d33a8b342 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b349 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842028.753650:0:12960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43530a00/0x3de1064d33a8b342 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3de1064d33a8b349 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842028.753656:0:12960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.155@tcp lock: ffff8d3a43530a00/0x3de1064d33a8b342 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3de1064d33a8b349 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842028.753677:0:12960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788842028.753685:0:12960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a82044e00/0x3de1064d33a8adf4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8adfb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842028.753698:0:12960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a82044e00/0x3de1064d33a8adf4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8adfb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842028.753704:0:12960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a82044e00/0x3de1064d33a8adf4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3de1064d33a8adfb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842028.753734:0:12960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.155@tcp lock: ffff8d3a82044e00/0x3de1064d33a8adf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3de1064d33a8adfb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842028.753746:0:12960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788842028.753749:0:12960:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788842028.753753:0:12960:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788842028.753777:0:12960:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788842028.753781:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788842028.753784:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788842028.753790:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1788842028.753795:0:12960:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8d3a7c0b8000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788842028.753801:0:12960:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8d3944c37800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788842028.753808:0:12960:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8d3a75de5000 419331f1-87f8-40c5-a1c8-5f66078f5ec5 192.168.204.55@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788842028.753813:0:12960:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8d3a76a899b8) has exports, disconnecting them 00000020:00080000:1.0:1788842028.753827:0:12960:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d3a7c0b8000), last request at 1788842024 00000020:00000080:1.0:1788842028.753834:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8b008 00000100:00080000:1.0:1788842028.753850:0:12960:0:(import.c:65:import_set_state_nolock()) ffff8d3a7c0bb800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788842028.753897:0:12960:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d3a7c0b8000): rc 0 00000020:00000080:1.0:1788842028.753899:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d3a7c0b8000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788842028.753907:0:12960:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d3944c37800), last request at 1788842024 00000020:00000080:1.0:1788842028.753910:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8af3d 00000100:00080000:1.0:1788842028.753920:0:12960:0:(import.c:65:import_set_state_nolock()) ffff8d3944c36800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788842028.753929:0:12960:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d3944c37800): rc 0 00000020:00000080:1.0:1788842028.753931:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d3944c37800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1788842028.753942:0:12960:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffab9c81c83ae0 00000100:00080000:1.0:1788842028.753959:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788842028.753962:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1788842028.753973:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788842028.754032:0:12960:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788842028.754046:0:12960:0:(import.c:65:import_set_state_nolock()) ffff8d3a75ee2800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788842028.754056:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788842028.754059:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1788842028.754066:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788842028.754189:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500720256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788842028.754261:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842028.754316:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788842028.754323:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500720128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788842028.754344:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788842028.754367:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788842028.754373:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a43530a00/0x3de1064d33a8b342 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3de1064d33a8b349 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842028.754381:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43530a00 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:0.0:1788842028.754384:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a43530a00/0x3de1064d33a8b342 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3de1064d33a8b349 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842028.754549:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a43530a00/0x3de1064d33a8b342 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3de1064d33a8b349 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788842028.754557:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a43530a00/0x3de1064d33a8b342 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3de1064d33a8b349 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788842028.754563:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788842028.754565:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788842028.754567:0:5839:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788842028.754585:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a43530a00/0x3de1064d33a8b342 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3de1064d33a8b349 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842028.754591:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788842028.754607:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a43530a00/0x3de1064d33a8b342 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3de1064d33a8b349 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842028.754614:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a43530a00/0x3de1064d33a8b342 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3de1064d33a8b349 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842028.754625:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788842028.754628:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a82044e00/0x3de1064d33a8adf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3de1064d33a8adfb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842028.754634:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a82044e00 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:0.0:1788842028.754637:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a82044e00/0x3de1064d33a8adf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3de1064d33a8adfb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842028.754644:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a82044e00/0x3de1064d33a8adf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3de1064d33a8adfb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788842028.754661:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a82044e00/0x3de1064d33a8adf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3de1064d33a8adfb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788842028.754666:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788842028.754668:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788842028.754670:0:5839:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788842028.754683:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a82044e00/0x3de1064d33a8adf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3de1064d33a8adfb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842028.754689:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788842028.754696:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a82044e00/0x3de1064d33a8adf4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3de1064d33a8adfb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842028.754701:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a82044e00/0x3de1064d33a8adf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3de1064d33a8adfb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842028.754732:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842028.754734:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842028.754735:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788842028.754757:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500720256 00000100:00100000:0.0:1788842028.754764:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500720256 00000020:00000080:3.0:1788842028.754772:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a7c0b8000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:0.0:1788842028.754806:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500720128 00000100:00100000:0.0:1788842028.754809:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500720128 00000020:00000080:3.0:1788842028.754825:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3944c37800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:0.0:1788842028.754830:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788842028.754838:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76807800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3308:x1875736500720256:12345-0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1788842028.754848:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3a7c0bb800 for lustre-MDT0000 00010000:00010000:0.0:1788842028.754850:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:3.0:1788842028.754853:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3944c36800 for lustre-MDT0000 00010000:00010000:0.0:1788842028.754862:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a40031600/0x3de1064d33a8b047 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3de1064d33a8b040 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842028.754866:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500720512:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788842028.754885:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788842028.754896:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842028.754912:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788842028.754917:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76805500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500720640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788842028.754925:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76807800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:3308:x1875736500720256:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842028.754933:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788842028.754935:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842028.754947:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500720512 00010000:00010000:3.0:1788842028.754950:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788842028.754950:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500720512 00000100:00100000:0.0:1788842028.754962:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500720640 00000100:00100000:0.0:1788842028.754965:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500720640 00000100:00100000:0.0:1788842028.754975:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788842028.754978:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875736500720384:0@lo:9:umount.0 00000100:00100000:0.0:1788842028.754980:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+19:3308:x1875736500720128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788842028.754987:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788842028.754996:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a43530c00/0x3de1064d33a8b120 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3de1064d33a8b119 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842028.755004:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788842028.755008:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842028.755022:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+18:3308:x1875736500720128:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842028.755028:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788842028.755038:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500720384 00000100:00100000:0.0:1788842028.755039:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788842028.755041:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500720384 00000100:00100000:0.0:1788842028.755044:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+17:3309:x1875736500720512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788842028.755051:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788842028.755059:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a40031800/0x3de1064d33a8b349 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3de1064d33a8b342 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842028.755068:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788842028.755078:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788842028.755085:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875736500720384:12345-0@lo:9:umount.0 00000100:00100000:0.0:1788842028.755090:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+16:3309:x1875736500720512:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (194us total) trans 0 rc 0/0 00000020:00000080:3.0:1788842028.755105:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8af8a 00000100:00080000:3.0:1788842028.755111:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8d3944c34000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788842028.755140:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:1.0:1788842028.755376:0:12960:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788842028.755388:0:12960:0:(import.c:65:import_set_state_nolock()) ffff8d3944ec1800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788842028.755571:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788842028.755587:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788842028.755594:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+15:3309:x1875736500720640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788842028.755601:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788842028.755611:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a82045800/0x3de1064d33a8adfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3de1064d33a8adf4 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842028.755621:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788842028.755645:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:3309:x1875736500720640:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842028.755650:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1788842028.755703:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842028.755724:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788842028.755787:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875736500720768:0@lo:9:umount.0 00000100:00100000:2.0:1788842028.755828:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788842028.755927:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8d3a76a899b8) has no exports 00000100:00100000:0.0:1788842028.756128:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500720128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788842028.756140:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500720256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788842028.758874:0:8622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500720768 00000100:00100000:1.0:1788842028.758890:0:8622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500720768 00000100:00100000:1.0:1788842028.758947:0:8622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788842028.758958:0:8622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76864700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875736500720768:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788842028.758987:0:8622:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8b071 00000100:00080000:1.0:1788842028.758996:0:8622:0:(import.c:65:import_set_state_nolock()) ffff8d3a75ee7800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788842028.759039:0:8622:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:0.0:1788842028.760777:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788842028.760785:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788842028.760837:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76805500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500720640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788842028.760849:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500720512:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788842028.761260:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8d3a75ee2800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788842028.761280:0:3306:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788842028.761283:0:3306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788842028.761286:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875736500720384:0@lo:9:umount.0 00000100:00080000:2.0:1788842028.761313:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8d3944ec1800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788842028.761322:0:3306:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788842028.761324:0:3306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788842028.761326:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875736500720768:0@lo:9:umount.0 00010000:00010000:2.0:1788842028.761899:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788842028.761943:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3306:x1875736500720384:12345-0@lo:9:umount.0 Request processed in 6855us (6930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842028.761953:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:3.0:1788842028.761978:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788842028.762294:0:8622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76864700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3306:x1875736500720768:12345-0@lo:9:umount.0 Request processed in 3336us (6462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842028.762302:0:8622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000020:00080000:1.0:1788842028.776537:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8d3a76a899b8) has no exports 00000020:00000080:1.0:1788842028.842384:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8ae4f 00000020:00000080:1.0:1788842028.842401:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d3a68249000/lustre-QMT0000_UUID 00000020:01000000:1.0:1788842028.842413:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788842028.842987:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a68249000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788842028.843015:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788842028.843026:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788842028.843031:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8d3a43568000) has no exports 00000020:00000080:2.0:1788842028.845207:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8ae48 00000020:00000080:2.0:1788842028.845220:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d3a77ae4000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788842028.845286:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788842028.845296:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788842028.845299:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d3a77ae5000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788842028.845302:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a77ae5000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788842028.845309:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788842028.845552:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a77ae4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1788842028.930205:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788842029.188314:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788842029.188338:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875736500721152:0@lo:400:kworker.0 00000100:00100000:0.0:1788842029.188413:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842029.188553:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500720896:0@lo:400:kworker.0 00000100:00100000:3.0:1788842029.188591:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842029.188629:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788842029.188634:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76805500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500721024:0@lo:400:kworker.0 00000100:00100000:3.0:1788842029.188659:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842029.188736:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500721152 00000100:00100000:0.0:1788842029.188736:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500720896 00000100:00100000:2.0:1788842029.188743:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500721152 00000100:00100000:0.0:1788842029.188744:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500720896 00000100:00100000:0.0:1788842029.188778:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788842029.188792:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:3307:x1875736500720896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788842029.188832:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500721024 00000100:00100000:2.0:1788842029.188836:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500721024 00000100:00100000:0.0:1788842029.188969:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd738bcb-4fee-4a21-af92-bab36d5458e2+14:3307:x1875736500720896:12345-0@lo:400:kworker.0 Request processed in 180us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842029.188972:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788842029.188977:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788842029.188978:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3310:x1875736500721152:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788842029.188984:0:6963:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788842029.189017:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3310:x1875736500721152:12345-0@lo:400:kworker.0 Request processed in 38us (604us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788842029.189022:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd738bcb-4fee-4a21-af92-bab36d5458e2:3307:1875736500720896:0@lo:400:kworker.0 00000100:00100000:3.0:1788842029.189023:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788842029.189036:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788842029.189040:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3307:x1875736500721024:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788842029.189044:0:6963:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:0.0:1788842029.189047:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788842029.189051:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d3a434a6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788842029.189055:0:3310:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788842029.189066:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3307:x1875736500721024:12345-0@lo:400:kworker.0 Request processed in 25us (408us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788842029.189072:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1788842029.189962:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788842029.189966:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d3944ed1800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788842029.189981:0:3307:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788842029.189987:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d3944ed1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788842029.189990:0:3307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 142 00000100:00080000:2.0:1788842029.189998:0:3307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d3944ed1800 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:2.0:1788842029.190028:0:3307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3a49adc700 x1875736500721280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788842029.190049:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76805500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500721024:0@lo:400:kworker.0 00000100:00100000:2.0:1788842029.190073:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875736500721280:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788842029.190124:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842029.190168:0:8623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500721280 00000100:00100000:2.0:1788842029.190173:0:8623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500721280 00000100:00100000:2.0:1788842029.190196:0:8623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788842029.190202:0:8623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3306:x1875736500721280:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1788842029.190218:0:8623:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1788842029.196371:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d3a434a6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788842029.196381:0:3310:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 161 00000100:00080000:0.0:1788842029.196390:0:3310:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d3a434a6800 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:0.0:1788842029.196432:0:3310:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3a76804380 x1875736500721408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788842029.196476:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875736500721152:0@lo:400:kworker.0 00000100:00100000:3.0:1788842029.203046:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875736500721408:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788842029.203133:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842029.203258:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500721408 00000100:00100000:0.0:1788842029.203267:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500721408 00000100:00100000:0.0:1788842029.203816:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788842029.203836:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875736500721408:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1788842029.203860:0:5850:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788842029.203932:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875736500721408:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 106us (799us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788842029.203939:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:3.0:1788842029.212095:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8d3a434a6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788842029.212110:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788842029.212115:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875736500721408:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788842029.216355:0:8623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3306:x1875736500721280:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 26140us (26220us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788842029.216370:0:8623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1788842029.216576:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8d3944ed1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788842029.216583:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788842029.216587:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875736500721280:0@lo:38:ptlrpcd_00_00.0 00000001:00100000:1.0:1788842029.764364:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788842029.764376:0:7641:0:(genops.c:885:class_export_put()) final put ffff8d3a75ee5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788842029.764459:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a75ee5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788842029.764600:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3a75ee7800 for lustre-OST0001 00010000:00010000:2.0:1788842029.954310:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788842030.308072:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788842030.308088:0:6720:0:(genops.c:885:class_export_put()) final put ffff8d3944c33000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788842030.308482:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3944c33000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788842030.308581:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3944c34000 for lustre-OST0000 00000001:00100000:0.0:1788842030.333597:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 419331f1-87f8-40c5-a1c8-5f66078f5ec5 00000001:00080000:0.0:1788842030.333622:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1788842030.333629:0:5873:0:(genops.c:885:class_export_put()) final put ffff8d3a75de5000/419331f1-87f8-40c5-a1c8-5f66078f5ec5 00000020:00000080:0.0:1788842030.333657:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a75de5000/419331f1-87f8-40c5-a1c8-5f66078f5ec5 for lustre-MDT0000 00000020:00000080:0.0:1788842030.333743:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3a75de4800 for lustre-MDT0000 00000020:01000000:2.0:1788842030.850398:0:12960:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d3a4992f240 - data ffff8d3a5f3ccbd0/ffff8d3944e74800 00000020:01000000:2.0:1788842030.850579:0:12960:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d3a44f7b540 - data ffff8d3a6fc64870/ffff8d3a7b7b1800 00000001:00000004:2.0:1788842030.862831:0:12960:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:0.0:1788842030.979740:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788842031.023811:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788842031.023823:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788842031.023879:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788842031.023882:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788842031.027658:0:7080:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788842031.027668:0:7080:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1788842031.027682:0:7080:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788842031.028847:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788842031.028855:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788842031.028875:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788842031.028877:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788842031.030025:0:7985:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788842031.030033:0:7985:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1788842031.030049:0:7985:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788842031.124265:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8ae17 00000020:00000080:0.0:1788842031.124284:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d3a76ab9000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788842031.124347:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a76ab9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788842031.126756:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8ae2c 00000020:00000080:1.0:1788842031.126775:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d3a76a96800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788842031.126863:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788842031.126871:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788842031.126884:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788842031.126890:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8d3a76a8cd28) has no exports 00000004:01000000:1.0:1788842031.127123:0:12960:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788842031.127134:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8b06a 00000020:00000080:1.0:1788842031.127140:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d39445e4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788842031.127631:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a76a96800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788842031.127735:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788842031.127741:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788842031.127755:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788842031.127759:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8d39462e8000) has no exports 00000020:00000080:1.0:1788842031.127768:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8b063 00000020:00000080:1.0:1788842031.127774:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d3944ec3000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788842031.128042:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d39445e4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788842031.128051:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3944ec3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788842031.128386:0:12960:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788842031.128392:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788842031.128398:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1788842031.128405:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788842031.128408:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788842031.128532:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788842031.128543:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788842031.128550:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8af83 00000020:00000080:1.0:1788842031.128556:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d3944c33800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788842031.128562:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788842031.128567:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788842031.128571:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788842031.128575:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8d3a75f24d28) has no exports 00000020:00000080:1.0:1788842031.128580:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8af7c 00000020:00000080:1.0:1788842031.128584:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d3a75ee7000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788842031.129058:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3944ec1800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788842031.129143:0:37:0:(genops.c:885:class_export_put()) final put ffff8d3a7f1fe800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788842031.129147:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a7f1fe800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788842031.129156:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788842031.129272:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3944c33800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788842031.129278:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a75ee7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788842031.129384:0:12960:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788842031.129388:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788842031.129392:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1788842031.129397:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788842031.129400:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788842031.129550:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788842031.129561:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788842031.129596:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788842031.129599:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788842031.129603:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d3a76ab9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788842031.129606:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a76ab9800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788842031.129611:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788842031.129824:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8ae33 00000020:00000080:1.0:1788842031.129832:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d3a76a97800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788842031.130301:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3a75ee2800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788842031.130310:0:37:0:(genops.c:885:class_export_put()) final put ffff8d3a75ee0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788842031.130313:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a75ee0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788842031.130324:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788842031.130563:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788842031.130570:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788842031.130579:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788842031.130584:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8d3a76a88000) has no exports 00000020:00000080:1.0:1788842031.130609:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788842031.130614:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788842031.130619:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8ae3a 00000020:00000080:1.0:1788842031.130625:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d3a76a90800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788842031.130637:0:12960:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d3a43e8f800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788842031.130641:0:12960:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d3a43e8f800 3 00000020:01000004:1.0:1788842031.130645:0:12960:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d3a43e8f800 from lustre-MDT0000 00000020:00000080:1.0:1788842031.130669:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788842031.130673:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788842031.130676:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d3a76abe000/lustre-MDT0000_UUID 00000020:00000080:1.0:1788842031.130678:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a76abe000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788842031.130687:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788842031.130744:0:12960:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788842031.130748:0:12960:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788842031.130761:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788842031.130765:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788842031.130767:0:12960:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788842031.130776:0:12960:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8d3a4e497800 fd738bcb-4fee-4a21-af92-bab36d5458e2 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788842031.130782:0:12960:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8d3a4e55b370) has exports, disconnecting them 00000020:00080000:1.0:1788842031.130788:0:12960:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8d3a4e497800), last request at 1788841794 00000020:00000080:1.0:1788842031.130808:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8add8 00000020:00010000:1.0:1788842031.130813:0:12960:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d3a4e497800: total 2 00000100:00080000:1.0:1788842031.130818:0:12960:0:(import.c:65:import_set_state_nolock()) ffff8d3a4e496800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788842031.130837:0:12960:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d3a4e497800): rc 0 00000020:00080000:1.0:1788842031.130842:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8d3a4e55b370) has no exports 00000100:00100000:1.0:1788842031.130908:0:5844:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8d3a57040a00:5844] 1 exiting: rc = 0 00000020:00010000:0.0:1788842031.131044:0:8448:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d3a4e497800: total 2 00010000:00010000:0.0:1788842031.131085:0:8448:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d3a4e497800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788842031.131122:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a7c78f400/0x3de1064d33a8b0f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3de1064d33a8b0ef expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842031.131142:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a60053600/0x3de1064d33a8b104 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3de1064d33a8b0fd expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842031.131166:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a7c78e000/0x3de1064d33a8b32d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3de1064d33a8b326 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842031.131180:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a40030400/0x3de1064d33a8b33b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3de1064d33a8b334 expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842031.131204:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a4dc95e00/0x3de1064d33a8aef0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3de1064d33a8aee9 expref: 5 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842031.131233:0:5842:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8d3a57040e00:5842] 0 exiting: rc = 1 00010000:00010000:0.0:1788842031.131245:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a43530e00/0x3de1064d33a8b12e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3de1064d33a8b127 expref: 4 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842031.131259:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a7c78ee00/0x3de1064d33a8b0da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3de1064d33a8b0d3 expref: 3 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842031.131272:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a60053400/0x3de1064d33a8b0e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3de1064d33a8b0e1 expref: 2 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842031.131289:0:8448:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d3a4e497800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788842031.131303:0:8448:0:(genops.c:885:class_export_put()) final put ffff8d3a4e497800/fd738bcb-4fee-4a21-af92-bab36d5458e2 00010000:00010000:0.0:1788842031.131311:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842031.131313:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842031.131315:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788842031.131342:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a76a97800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788842031.131349:0:37:0:(genops.c:885:class_export_put()) final put ffff8d3a76abb000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788842031.131352:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a76abb000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788842031.131357:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788842031.131601:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a76a90800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788842031.131606:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a4e497800/fd738bcb-4fee-4a21-af92-bab36d5458e2 for MGS 00000020:00000080:2.0:1788842031.131642:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3a4e496800 for MGS 00000100:00100000:3.0:1788842031.131853:0:5845:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8d3a57040c00:5845] 2 exiting: rc = 0 00000100:00100000:1.0:1788842031.133153:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133166:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133172:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133179:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133185:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133193:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133199:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133205:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133212:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133219:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133226:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133233:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133241:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133246:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133252:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133257:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133262:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133268:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133274:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133281:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133303:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133309:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133316:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133324:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133330:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133336:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133343:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133351:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133356:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133362:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133368:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133373:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133379:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133385:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133390:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133396:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133401:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133406:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133413:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133419:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133425:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133431:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133437:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133443:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133785:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133793:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133800:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133806:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133812:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133818:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133825:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133830:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133837:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133843:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133848:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133865:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133872:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133880:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133886:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133892:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133898:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133903:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133910:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.133916:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788842031.134661:0:12960:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788842031.134668:0:12960:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1788842031.136129:0:12960:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d394720e360 - data ffff8d3a6fd9c948/ffff8d3a76255c00 00000020:01000000:1.0:1788842031.136280:0:12960:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d3a43ee7d80 - data ffff8d3a422676c0/ffff8d3a47d51400 00000020:00000080:1.0:1788842031.136913:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8adbc 00000020:00000080:1.0:1788842031.136924:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d3a450cf800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788842031.137139:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a450cf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1788842031.137194:0:12960:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d3a43e8f800 from MGS, refs=2 00000020:01000004:1.0:1788842031.137198:0:12960:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d3a43e8f800 2 00000020:01000004:1.0:1788842031.137203:0:12960:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d3a43e8f800 from MGS 00000020:00000080:1.0:1788842031.137232:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788842031.137241:0:12960:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788842031.137244:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d3a43480000/MGS 00000020:00000080:1.0:1788842031.137247:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a43480000/MGS for MGS 00000020:01000000:1.0:1788842031.137259:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788842031.137339:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788842031.137344:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788842031.137350:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788842031.137358:0:12960:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8d3a77ae1000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788842031.137365:0:12960:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8d3a4356b370) has exports, disconnecting them 00000020:00080000:1.0:1788842031.137371:0:12960:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8d3a77ae1000), last request at 1788841795 00000020:00000080:1.0:1788842031.137376:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8ae87 00000020:00080000:1.0:1788842031.137388:0:12960:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d3a77ae1000): rc 0 00000020:00000080:1.0:1788842031.137393:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d3a77ae1000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788842031.139656:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a77ae1000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788842031.160680:0:12960:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788842031.160694:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788842031.160700:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788842031.160878:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788842031.161342:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788842031.161353:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788842031.161362:0:12960:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d3a43e8f800 1 00000020:00000080:1.0:1788842031.161371:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8adae 00000020:00000080:1.0:1788842031.161383:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d3a43485000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788842031.161414:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3a77aec000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788842031.161422:0:36:0:(genops.c:885:class_export_put()) final put ffff8d3a77ae9800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788842031.161426:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a77ae9800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788842031.161437:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788842031.162140:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a43485000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788842031.162217:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788842031.162224:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788842031.162231:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788842031.162237:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8d3a4356cd28) has no exports 00000020:00000080:2.0:1788842031.234151:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788842031.234175:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788842031.234184:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d3a450cd000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788842031.234190:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a450cd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788842031.234204:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788842031.234730:0:12960:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d3a43e8e000 00000020:01000000:2.0:1788842031.234759:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788842031.234765:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788842031.234772:0:12960:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788842031.234777:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8d3a4e55cd28) has no exports 00000100:00100000:2.0:1788842031.234905:0:8623:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8d3a765a3a00:8623] 4 exiting: rc = 0 00000100:00100000:3.0:1788842031.234961:0:5852:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8d3a65822c00:5852] 2 exiting: rc = 0 00000100:00100000:0.0:1788842031.235225:0:6963:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8d3a7baea200:6963] 3 exiting: rc = 0 00000100:00100000:0.0:1788842031.235462:0:5850:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8d3a4ec20e00:5850] 0 exiting: rc = 1 00000100:00100000:0.0:1788842031.235844:0:5851:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8d3a4ec21200:5851] 1 exiting: rc = 0 00000100:00100000:2.0:1788842031.237473:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237498:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237504:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237511:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237517:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237523:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237530:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237537:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237543:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237549:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237555:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237561:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237566:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237573:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237594:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237600:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237606:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237687:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237695:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237702:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237721:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237728:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237735:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237742:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237747:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237754:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237759:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237765:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237771:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237778:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237783:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237790:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237796:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237802:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237808:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237813:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237819:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237826:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237831:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237838:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237844:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237851:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237858:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237863:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237869:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237875:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237882:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237888:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237894:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237907:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237914:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237921:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237927:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237934:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237941:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237946:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237952:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237959:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237964:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237970:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237976:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237982:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237989:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.237996:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842031.250359:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8d3a65908200:5853] 0 exiting: rc = 1 00000100:00100000:2.0:1788842031.253199:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8d3a65822800:5854] 1 exiting: rc = 0 00000100:00100000:1.0:1788842031.255917:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.255930:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.255937:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.255944:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.255950:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.255956:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.255962:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.255968:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.255974:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.255981:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.255987:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.255994:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256001:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256006:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256012:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256018:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256023:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256028:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256035:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256040:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256046:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256199:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256205:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256210:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256215:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256221:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256226:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256232:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256237:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256243:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256248:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256253:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256258:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256264:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256269:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256274:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256279:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256285:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256290:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256295:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256301:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256307:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256312:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256318:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256323:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256329:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256335:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256340:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256345:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256351:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256357:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256362:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256368:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256374:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256379:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256384:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256399:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256404:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256411:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256417:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256422:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256428:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256434:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.256440:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.257750:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8d3a4e423600:5855] 0 exiting: rc = 1 00000100:00100000:0.0:1788842031.258318:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8d3a4e423200:5856] 1 exiting: rc = 0 00000100:00100000:1.0:1788842031.258455:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258468:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258474:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258492:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258499:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258507:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258514:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258522:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258531:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258538:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258547:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258555:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258562:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258588:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258599:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258605:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258612:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258621:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258628:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258635:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258641:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258649:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258657:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258665:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258673:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258694:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258702:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.258999:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259005:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259013:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259020:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259026:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259033:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259040:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259047:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259053:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259059:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259080:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259088:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259094:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259101:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259107:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259114:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259268:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259277:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259283:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259289:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259295:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259301:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259321:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259328:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259333:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259340:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259346:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259353:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259359:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259365:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259377:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259383:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259389:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259396:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259403:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259418:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.259436:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.273777:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8d3a433a1a00:5857] 0 exiting: rc = 1 00000100:00100000:0.0:1788842031.274228:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8d3a433a1400:5858] 1 exiting: rc = 0 00000100:00100000:2.0:1788842031.274383:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274392:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274398:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274404:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274409:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274414:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274421:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274426:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274432:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274437:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274444:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274449:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274455:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274460:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274466:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274471:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274491:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274499:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274527:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274532:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274537:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274542:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274548:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274553:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274558:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274563:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274568:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274574:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274579:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274584:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274590:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274596:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274602:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274607:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274614:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274620:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274626:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274632:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274638:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274642:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274648:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274654:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274660:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274666:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274672:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274678:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274683:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274688:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274693:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274698:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274705:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274953:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274959:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274972:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274979:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274985:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274990:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.274995:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.275001:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.275006:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.275011:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.275016:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.275021:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.275026:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842031.276092:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8d3a65822000:5860] 1 exiting: rc = 0 00000100:00100000:0.0:1788842031.276389:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8d3a433a1000:5859] 0 exiting: rc = 1 00000100:00100000:2.0:1788842031.276521:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276529:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276535:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276542:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276547:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276553:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276558:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276563:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276569:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276575:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276580:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276586:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276592:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276598:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276603:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276608:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276614:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276620:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276626:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276631:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276637:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276642:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276649:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276655:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276676:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276681:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276687:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276692:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276697:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.276702:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279572:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279601:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279607:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279613:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279619:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279626:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279631:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279637:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279645:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279651:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279657:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279663:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279669:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279675:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279682:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279687:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279692:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279698:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279705:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279738:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279744:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279750:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279756:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279761:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279767:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279773:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279779:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279784:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279790:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279823:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279829:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279834:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279840:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.279846:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842031.281003:0:5861:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8d3a4ec23c00:5861] 0 exiting: rc = 1 00000100:00100000:3.0:1788842031.281334:0:5862:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8d3a4ec22200:5862] 1 exiting: rc = 0 00000100:00100000:2.0:1788842031.281455:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281463:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281469:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281474:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281492:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281498:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281504:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281510:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281515:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281522:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281528:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281533:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281539:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281544:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281550:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281556:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281562:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281569:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281577:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281582:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281587:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281592:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281597:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281602:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281607:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281613:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281617:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281623:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281628:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281632:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281655:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281662:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281667:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281673:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281678:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281684:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281691:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281698:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281704:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281784:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281790:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281796:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281801:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281807:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281812:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281817:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281823:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281828:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281833:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281839:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281844:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281850:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281855:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281862:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281868:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281873:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281879:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281884:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281890:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281895:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281901:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281905:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281911:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.281918:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842031.282975:0:5864:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8d3a4ec22600:5864] 1 exiting: rc = 0 00000100:00100000:1.0:1788842031.283687:0:5863:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8d3a4ec23e00:5863] 0 exiting: rc = 1 00000100:00100000:0.0:1788842031.284253:0:5865:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8d3a4e5da000:5865] 2 exiting: rc = 0 00000100:00100000:2.0:1788842031.284505:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284533:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284540:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284547:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284555:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284561:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284569:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284576:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284598:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284604:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284612:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284618:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284625:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284630:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284637:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284644:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284650:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284656:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284662:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284668:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284674:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284681:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284687:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284693:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284699:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284848:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284859:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284865:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284872:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284878:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284885:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284893:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284917:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284925:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284932:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284938:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284954:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284960:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284967:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284973:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284979:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284985:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284992:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.284999:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.285005:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.285012:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.285018:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.285024:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.285030:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.285036:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.285042:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.285048:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.285053:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.285059:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.285348:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.285356:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.285376:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.285383:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.285389:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.285395:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.285401:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.285408:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.285414:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842031.285420:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788842031.292347:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788842031.292367:0:12960:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788842031.292375:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d3a4eb9a800/MDS_uuid 00000020:00000080:2.0:1788842031.292381:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a4eb9a800/MDS_uuid for MDS 00000020:01000000:2.0:1788842031.292397:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788842031.292670:0:12960:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788842032.004962:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842033.027972:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842034.055669:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788842034.139226:0:13112:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788842034.151925:0:13112:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788842034.151978:0:13112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8b0ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b0f6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842034.151993:0:13112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8b0ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b0f6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842034.152000:0:13112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8b0ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3de1064d33a8b0f6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842034.152007:0:13112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8b0ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3de1064d33a8b0f6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842034.152033:0:13112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788842034.152038:0:13112:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788842034.152060:0:13112:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788842034.152065:0:13112:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788842034.152071:0:13112:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788842034.152076:0:13112:0:(import.c:65:import_set_state_nolock()) ffff8d3944ed1800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788842034.152081:0:13112:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788842034.152083:0:13112:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788842034.152086:0:13112:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788842034.152722:0:8448:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788842034.152733:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8b0ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x3de1064d33a8b0f6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842034.152742:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053a00 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:3.0:1788842034.152747:0:8448:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8b0ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x3de1064d33a8b0f6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842034.152756:0:8448:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8b0ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x3de1064d33a8b0f6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788842034.152763:0:8448:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8b0ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x3de1064d33a8b0f6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788842034.152768:0:8448:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788842034.152771:0:8448:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788842034.152773:0:8448:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788842034.152811:0:8448:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8b0ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3de1064d33a8b0f6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842034.152817:0:8448:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788842034.152849:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8b0ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3de1064d33a8b0f6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842034.152880:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8b0ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3de1064d33a8b0f6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842034.152898:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842034.152901:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842034.152903:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788842034.152912:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1788842034.152939:0:13112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b0fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b104 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842034.152960:0:13112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b0fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b104 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842034.152967:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500721536:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788842034.152970:0:13112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b0fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3de1064d33a8b104 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842034.152980:0:13112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b0fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3de1064d33a8b104 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842034.152997:0:13112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788842034.153003:0:13112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43531400/0x3de1064d33a8b334 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b33b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842034.153010:0:13112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43531400/0x3de1064d33a8b334 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b33b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842034.153016:0:13112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43531400/0x3de1064d33a8b334 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3de1064d33a8b33b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842034.153023:0:13112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.155@tcp lock: ffff8d3a43531400/0x3de1064d33a8b334 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3de1064d33a8b33b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842034.153037:0:13112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788842034.153041:0:13112:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000100:00100000:3.0:1788842034.153048:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1788842034.153063:0:13112:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788842034.153068:0:13112:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:1.0:1788842034.153081:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788842034.153086:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b0fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3de1064d33a8b104 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842034.153104:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43531200 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:1.0:1788842034.153107:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b0fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3de1064d33a8b104 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842034.153114:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b0fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x3de1064d33a8b104 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788842034.153121:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b0fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x3de1064d33a8b104 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788842034.153126:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788842034.153129:0:8447:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788842034.153131:0:8447:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788842034.153135:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788842034.153142:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a43531400/0x3de1064d33a8b334 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3de1064d33a8b33b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842034.153149:0:8447:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b0fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3de1064d33a8b104 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842034.153151:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43531400 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:3.0:1788842034.153157:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a43531400/0x3de1064d33a8b334 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3de1064d33a8b33b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842034.153162:0:8447:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788842034.153170:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a43531400/0x3de1064d33a8b334 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3de1064d33a8b33b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788842034.153178:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a43531400/0x3de1064d33a8b334 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3de1064d33a8b33b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842034.153181:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b0fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3de1064d33a8b104 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788842034.153188:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788842034.153195:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788842034.153196:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a43531200/0x3de1064d33a8b0fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3de1064d33a8b104 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788842034.153197:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788842034.153211:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842034.153213:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842034.153216:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842034.153217:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a43531400/0x3de1064d33a8b334 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3de1064d33a8b33b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842034.153223:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1788842034.153236:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788842034.153244:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a43531400/0x3de1064d33a8b334 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3de1064d33a8b33b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842034.153251:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a43531400/0x3de1064d33a8b334 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3de1064d33a8b33b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842034.153255:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500721792:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788842034.153267:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842034.153271:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842034.153273:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788842034.153293:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842034.153329:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500721664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788842034.153353:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1788842034.153380:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788842034.153387:0:13112:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788842034.153391:0:13112:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8d3a7c10cd28) has no exports 00000020:00080000:1.0:1788842034.153418:0:13112:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8d3a7c10cd28) has no exports 00000100:00100000:3.0:1788842034.154375:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500721536 00000100:00100000:3.0:1788842034.154387:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500721536 00000100:00100000:3.0:1788842034.154448:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500721792 00000100:00100000:3.0:1788842034.154452:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500721792 00000100:00100000:3.0:1788842034.154465:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500721664 00000100:00100000:3.0:1788842034.154469:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500721664 00000100:00100000:3.0:1788842034.154484:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788842034.154493:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3309:x1875736500721536:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788842034.154500:0:5835:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788842034 with bad export cookie 4458852034722442712 00000020:01000000:1.0:1788842034.155843:0:13112:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d3a49846e40 - data ffff8d3a6ffaf0d8/ffff8d3a767c2c00 00000100:00100000:0.0:1788842034.155845:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788842034.155854:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a412a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3308:x1875736500721792:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788842034.155861:0:5836:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788842034 with bad export cookie 4458852034722442712 00000020:01000000:1.0:1788842034.155979:0:13112:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d3a76362a80 - data ffff8d3a6fed6360/ffff8d3944ee5400 00000100:00100000:0.0:1788842034.156202:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a412a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3308:x1875736500721792:12345-0@lo:103:ldlm_bl.0 Request processed in 347us (2908us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788842034.156222:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788842034.156243:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788842034.156248:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3308:x1875736500721664:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788842034.156252:0:5836:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788842034 with bad export cookie 4458852034722442712 00000100:00100000:0.0:1788842034.156286:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3308:x1875736500721664:12345-0@lo:103:ldlm_bl.0 Request processed in 37us (2932us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788842034.156292:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788842034.156301:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.155@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788842034.156307:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8d3a4eb89000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788842034.156311:0:3308:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1788842034.167448:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3309:x1875736500721536:12345-0@lo:103:ldlm_bl.0 Request processed in 12665us (14111us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788842034.167463:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788842034.167817:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.155@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788842034.180042:0:3308:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.155@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788842034.180048:0:3308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788842034.180057:0:3308:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d3a7c6a5500 x1875736500721536/t0(0) o103->MGC192.168.204.155@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788842050 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788842034.180075:0:3308:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d3a7c6a4700 x1875736500721792/t0(0) o103->MGC192.168.204.155@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788842050 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788842034.180084:0:3308:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d3a412ab800 x1875736500721664/t0(0) o103->MGC192.168.204.155@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788842050 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788842034.180099:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788842034.180102:0:3308:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788842034.180104:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788842034.180170:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8d3a4eb89000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788842034.180170:0:3309:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8d3a4eb89000 already not connected (conn 1, was 1): DISCONN 00000100:00080000:2.0:1788842034.180176:0:3308:0:(import.c:510:import_select_connection()) MGC192.168.204.155@tcp: connect to NID 0@lo last attempt 122 00000100:00080000:2.0:1788842034.180185:0:3308:0:(import.c:624:import_select_connection()) MGC192.168.204.155@tcp: import ffff8d3a4eb89000 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:0.0:1788842034.180194:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd738bcb-4fee-4a21-af92-bab36d5458e2:3309:1875736500721536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788842034.180314:0:3308:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3a7c6a5c00 x1875736500721920/t0(0) o250->MGC192.168.204.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788842034.180358:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500721664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788842034.180374:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd738bcb-4fee-4a21-af92-bab36d5458e2:3308:1875736500721792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788842034.180918:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fd738bcb-4fee-4a21-af92-bab36d5458e2:3306:1875736500721920:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1788842034.180976:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875736500721920 offset 0 length 520: 4 00100000:10000000:1.0:1788842034.194801:0:13112:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788842034.229326:0:13112:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8af0c 00000020:00000080:0.0:1788842034.229337:0:13112:0:(genops.c:885:class_export_put()) final put ffff8d3944c32800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788842034.229357:0:13112:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d3a4e19d800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788842034.229361:0:13112:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d3a4e19d800 2 00000020:01000004:0.0:1788842034.229365:0:13112:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d3a4e19d800 from lustre-OST0000 00000020:00000080:0.0:1788842034.229387:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788842034.229397:0:13112:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788842034.229400:0:13112:0:(genops.c:885:class_export_put()) final put ffff8d3944c35000/lustre-OST0000_UUID 00000020:00000080:0.0:1788842034.229403:0:13112:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3944c35000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788842034.229411:0:13112:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788842034.229472:0:13112:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788842034.229476:0:13112:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788842034.229481:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788842034.229485:0:13112:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788842034.229492:0:13112:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d394542b000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788842034.229513:0:13112:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8d3a4e5599b8) has exports, disconnecting them 00000020:00080000:0.0:1788842034.229518:0:13112:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d394542b000), last request at 1788841814 00000020:00000080:0.0:1788842034.229522:0:13112:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8af36 00000020:00080000:0.0:1788842034.229531:0:13112:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d394542b000): rc 0 00000020:00000080:0.0:1788842034.229536:0:13112:0:(genops.c:885:class_export_put()) final put ffff8d394542b000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788842034.230251:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3944c32800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788842034.230275:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d394542b000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788842034.234354:0:13112:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788842034.234363:0:13112:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788842034.234368:0:13112:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788842034.234376:0:13112:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788842034.234583:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788842034.234593:0:13112:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1788842034.234600:0:13112:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d3a4e19d800 1 00000020:00000080:1.0:1788842034.234609:0:13112:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8aec6 00000020:00000080:1.0:1788842034.234620:0:13112:0:(genops.c:885:class_export_put()) final put ffff8d3a76abf000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788842034.234626:0:13112:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788842034.234632:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788842034.234637:0:13112:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788842034.234641:0:13112:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8d3a76a8b370) has no exports 00000020:00000080:3.0:1788842034.235004:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3944ed1800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788842034.235015:0:36:0:(genops.c:885:class_export_put()) final put ffff8d3944ed3000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788842034.235018:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3944ed3000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788842034.235024:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788842034.235103:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a76abf000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788842034.247555:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788842034.247575:0:13112:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788842034.247583:0:13112:0:(genops.c:885:class_export_put()) final put ffff8d3a4e19e000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788842034.247588:0:13112:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a4e19e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788842034.247596:0:13112:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788842034.247777:0:13112:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d3a4e19b800 00000020:02000400:3.0:1788842034.247839:0:13112:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:1.0:1788842034.310596:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788842034.310605:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788842034.310610:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d3a434a6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788842034.310620:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 357 00000100:00080000:1.0:1788842034.310625:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788842034.310636:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d3a434a6800 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:1.0:1788842034.310689:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3a412ab480 x1875736500722048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788842034.311977:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875736500722048:0@lo:38:kworker.0 00000400:00000100:0.0:1788842034.312045:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875736500722048 offset 0 length 520: 4 00010000:00010000:0.0:1788842035.074221:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842036.097933:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788842037.021384:0:13263:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788842037.041095:0:13263:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788842037.041177:0:13263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8b0d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b0da expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842037.041194:0:13263:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8b0d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b0da expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842037.041326:0:13263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8b0d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3de1064d33a8b0da expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842037.041334:0:13263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8b0d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3de1064d33a8b0da expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842037.041358:0:13263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788842037.041363:0:13263:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788842037.041395:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788842037.041407:0:13263:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d3a412ab480 x1875736500722048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788842049 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788842037.041429:0:13263:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788842037.041435:0:13263:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788842037.041454:0:13263:0:(import.c:65:import_set_state_nolock()) ffff8d3a434a6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788842037.041459:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788842037.041464:0:13263:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d3a412ab480 x1875736500722048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788842049 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788842037.041471:0:13263:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788842037.041474:0:13263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00010000:00010000:2.0:1788842037.041533:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788842037.041540:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8b0d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3de1064d33a8b0da expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842037.041549:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a43530000 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:2.0:1788842037.041553:0:8447:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8b0d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3de1064d33a8b0da expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842037.041561:0:8447:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8b0d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3de1064d33a8b0da expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788842037.041568:0:8447:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8b0d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3de1064d33a8b0da expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788842037.041582:0:8447:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788842037.041585:0:8447:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788842037.041588:0:8447:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788842037.041602:0:8447:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d3a4eb89000 00010000:00010000:2.0:1788842037.041606:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8b0d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3de1064d33a8b0da expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842037.041613:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a43530000/0x3de1064d33a8b0d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3de1064d33a8b0da expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842037.041624:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842037.041626:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842037.041628:0:8447:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788842037.041754:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875736500722048:0@lo:38:kworker.0 00010000:00010000:0.0:1788842037.042893:0:13263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60053000/0x3de1064d33a8b0e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b0e8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842037.042908:0:13263:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60053000/0x3de1064d33a8b0e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b0e8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842037.042916:0:13263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60053000/0x3de1064d33a8b0e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3de1064d33a8b0e8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842037.042922:0:13263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.155@tcp lock: ffff8d3a60053000/0x3de1064d33a8b0e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3de1064d33a8b0e8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842037.043133:0:13263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788842037.043142:0:13263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8b326 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8b32d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842037.043149:0:13263:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8b326 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8b32d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842037.043156:0:13263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8b326 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3de1064d33a8b32d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842037.043162:0:13263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8b326 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3de1064d33a8b32d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842037.043378:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788842037.043386:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a60053000/0x3de1064d33a8b0e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3de1064d33a8b0e8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842037.043393:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053000 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:3.0:1788842037.043397:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a60053000/0x3de1064d33a8b0e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3de1064d33a8b0e8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842037.043406:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a60053000/0x3de1064d33a8b0e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3de1064d33a8b0e8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788842037.043413:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a60053000/0x3de1064d33a8b0e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3de1064d33a8b0e8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788842037.043429:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788842037.043432:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1788842037.043443:0:5838:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d3a4eb89000 00010000:00010000:3.0:1788842037.043447:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a60053000/0x3de1064d33a8b0e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3de1064d33a8b0e8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842037.043453:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a60053000/0x3de1064d33a8b0e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3de1064d33a8b0e8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842037.043512:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788842037.043517:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8b326 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3de1064d33a8b32d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842037.043524:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40030000 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:2.0:1788842037.043527:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8b326 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3de1064d33a8b32d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842037.043534:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8b326 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3de1064d33a8b32d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788842037.043541:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8b326 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3de1064d33a8b32d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788842037.043546:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788842037.043548:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788842037.043560:0:5838:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d3a4eb89000 00010000:00010000:2.0:1788842037.043563:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8b326 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x3de1064d33a8b32d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842037.043572:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842037.043573:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842037.043576:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842037.043647:0:13263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788842037.043652:0:13263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a40030000/0x3de1064d33a8b326 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x3de1064d33a8b32d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788842037.043668:0:13263:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1788842037.043673:0:13263:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1788842037.043675:0:13263:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788842037.043695:0:13263:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788842037.043699:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788842037.043819:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788842037.043825:0:13263:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788842037.043830:0:13263:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8d3a7c1099b8) has no exports 00000020:00080000:0.0:1788842037.043855:0:13263:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8d3a7c1099b8) has no exports 00000020:01000000:0.0:1788842037.046460:0:13263:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d3a49846180 - data ffff8d3a6ff04288/ffff8d3a767c0c00 00000020:01000000:0.0:1788842037.046619:0:13263:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d394720e5a0 - data ffff8d3a7fe1f948/ffff8d3944526c00 00010000:00010000:2.0:1788842037.048977:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788842037.070467:0:13263:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788842037.114816:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8afd7 00000020:00000080:3.0:1788842037.114827:0:13263:0:(genops.c:885:class_export_put()) final put ffff8d39445e4800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788842037.114851:0:13263:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d3944ec2800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788842037.114855:0:13263:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d3944ec2800 2 00000020:01000004:3.0:1788842037.114859:0:13263:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d3944ec2800 from lustre-OST0001 00000020:00000080:3.0:1788842037.114882:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788842037.114893:0:13263:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788842037.114896:0:13263:0:(genops.c:885:class_export_put()) final put ffff8d3a5e6ef000/lustre-OST0001_UUID 00000020:00000080:3.0:1788842037.114901:0:13263:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a5e6ef000/lustre-OST0001_UUID for lustre-OST0001 00000020:00000080:1.0:1788842037.114902:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d39445e4800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788842037.114908:0:13263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788842037.115171:0:13263:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import fd738bcb-4fee-4a21-af92-bab36d5458e2->MGS 00010000:00010000:3.0:1788842037.115261:0:13263:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a82044800/0x3de1064d33a8aee9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3de1064d33a8aef0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788842037.115276:0:13263:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a82044800/0x3de1064d33a8aee9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3de1064d33a8aef0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788842037.115282:0:13263:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788842037.115285:0:13263:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788842037.115289:0:13263:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788842037.115314:0:13263:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d3a4eb89000 00010000:00010000:3.0:1788842037.115318:0:13263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a82044800/0x3de1064d33a8aee9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3de1064d33a8aef0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842037.115336:0:13263:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cc800/0x3de1064d33a8b127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3de1064d33a8b12e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788842037.115343:0:13263:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cc800/0x3de1064d33a8b127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3de1064d33a8b12e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788842037.115347:0:13263:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788842037.115349:0:13263:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788842037.115351:0:13263:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788842037.115360:0:13263:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d3a4eb89000 00010000:00010000:3.0:1788842037.115362:0:13263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cc800/0x3de1064d33a8b127 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3de1064d33a8b12e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788842037.115392:0:13263:0:(import.c:65:import_set_state_nolock()) ffff8d3a4eb89000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788842037.115395:0:13263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788842037.115397:0:13263:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788842037.115398:0:13263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788842037.115402:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788842037.115413:0:13263:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d3a7c6a5c00 x1875736500721920/t0(0) o250->MGC192.168.204.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788842044 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788842037.115426:0:13263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788842037.115428:0:13263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:0.0:1788842037.115627:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fd738bcb-4fee-4a21-af92-bab36d5458e2:3306:1875736500721920:0@lo:250:ptlrpcd_00_01.0 10000000:01000000:3.0:1788842037.115764:0:13263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788842037.115771:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8adca 00000020:00000080:3.0:1788842037.115777:0:13263:0:(genops.c:885:class_export_put()) final put ffff8d3a4eb9f000/fd738bcb-4fee-4a21-af92-bab36d5458e2 00000020:01000000:3.0:1788842037.115795:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.155@tcp (flags='') 00000020:00000080:3.0:1788842037.115801:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788842037.115806:0:13263:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.155@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788842037.115815:0:13263:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8d3a435699b8) has no exports 10000000:01000000:0.0:1788842037.116009:0:5847:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788842037.116088:0:13263:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.155@tcp: client import never connected 00000100:00080000:3.0:1788842037.116091:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788842037.116093:0:13263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788842037.116094:0:13263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788842037.116098:0:13263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788842037.116125:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a4eb9f000/fd738bcb-4fee-4a21-af92-bab36d5458e2 for MGC192.168.204.155@tcp 00000020:00000080:3.0:1788842037.116135:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788842037.116138:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3a4eb89000 for MGC192.168.204.155@tcp 00000020:00000080:3.0:1788842037.116141:0:13263:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.155@tcp (uuid fd738bcb-4fee-4a21-af92-bab36d5458e2) 00000020:00000080:3.0:1788842037.116146:0:13263:0:(genops.c:885:class_export_put()) final put ffff8d3a5a362800/fd738bcb-4fee-4a21-af92-bab36d5458e2 00000020:00000080:3.0:1788842037.116149:0:13263:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a5a362800/fd738bcb-4fee-4a21-af92-bab36d5458e2 for MGC192.168.204.155@tcp 00000020:01000000:3.0:1788842037.116156:0:13263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.155@tcp (fd738bcb-4fee-4a21-af92-bab36d5458e2) 00000020:01000000:3.0:1788842037.116480:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788842037.116484:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788842037.116494:0:13263:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788842037.116499:0:13263:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8d3a5e6ea000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788842037.116505:0:13263:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8d3a4e558000) has exports, disconnecting them 00000020:00080000:3.0:1788842037.116510:0:13263:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8d3a5e6ea000), last request at 1788841832 00000020:00000080:3.0:1788842037.116514:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8b001 00000020:00080000:3.0:1788842037.116534:0:13263:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d3a5e6ea000): rc 0 00000020:00000080:3.0:1788842037.116538:0:13263:0:(genops.c:885:class_export_put()) final put ffff8d3a5e6ea000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788842037.116745:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a5e6ea000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1788842037.121929:0:8448:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:01000000:3.0:1788842037.133018:0:13263:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788842037.133028:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788842037.133032:0:13263:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788842037.133040:0:13263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788842037.133101:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3a434a6800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1788842037.133157:0:8447:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788842037.133521:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788842037.133689:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1788842037.135586:0:8448:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1788842037.135836:0:5833:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8d3a6a0afe00:5833] 0 exiting: rc = 1 00000100:00100000:1.0:1788842037.136011:0:5834:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8d3a54e6be00:5834] 1 exiting: rc = 0 00000100:00100000:0.0:1788842037.136697:0:7630:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8d39446a8e00:7630] 2 exiting: rc = 0 00000100:00100000:3.0:1788842037.138083:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.138417:0:5835:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8d3a478b5600:5835] 0 exiting: rc = 1 00000100:00100000:2.0:1788842037.138455:0:8449:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8d3a7c17c000:8449] 3 exiting: rc = 0 00000100:00100000:1.0:1788842037.138565:0:5837:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8d3a478b4600:5837] 2 exiting: rc = 0 00000100:00100000:0.0:1788842037.140052:0:5836:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8d3a478b5000:5836] 1 exiting: rc = 0 00000100:00100000:3.0:1788842037.140200:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140209:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140216:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140223:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140246:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140318:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140324:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140331:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140335:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140340:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140346:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140351:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140357:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140374:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140380:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140385:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140392:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140399:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140405:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140410:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140416:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140421:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140425:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140430:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140434:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140439:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140444:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140450:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140457:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140463:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140470:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140476:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140481:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140486:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140491:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140496:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140551:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140559:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140563:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140576:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140582:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140587:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140593:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140598:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140603:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140609:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140614:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140619:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140624:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140629:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140634:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140639:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140644:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140650:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140656:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140662:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140668:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140673:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140679:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140683:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140688:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140693:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140698:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.140703:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788842037.144109:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788842037.144120:0:13263:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788842037.144126:0:13263:0:(genops.c:885:class_export_put()) final put ffff8d3944ec4000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788842037.144130:0:13263:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3944ec4000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788842037.144136:0:13263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1788842037.144186:0:13263:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d3944ec2800 1 00000020:00000080:2.0:1788842037.144193:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3de1064d33a8afa6 00000020:00000080:2.0:1788842037.144199:0:13263:0:(genops.c:885:class_export_put()) final put ffff8d3a434a7800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788842037.144217:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788842037.144222:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788842037.144226:0:13263:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788842037.144230:0:13263:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8d3a75dd8000) has no exports 00000020:00000080:1.0:1788842037.144335:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a434a7800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788842037.162407:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788842037.162424:0:13263:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788842037.162430:0:13263:0:(genops.c:885:class_export_put()) final put ffff8d3944ec0800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788842037.162435:0:13263:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3944ec0800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788842037.162448:0:13263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788842037.162621:0:13263:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d3944ec5800 00000020:01000000:0.0:1788842037.162652:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788842037.162656:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788842037.162660:0:13263:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788842037.162664:0:13263:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8d3a7c10b370) has no exports 00000020:00000080:0.0:1788842037.162689:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788842037.162695:0:13263:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788842037.162697:0:13263:0:(genops.c:885:class_export_put()) final put ffff8d3a76abd800/OSS_uuid 00000020:00000080:0.0:1788842037.162700:0:13263:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3a76abd800/OSS_uuid for OSS 00000020:01000000:0.0:1788842037.162703:0:13263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788842037.162789:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8d3a48e20400:6695] 1 exiting: rc = 0 00000100:00080000:3.0:1788842037.162898:0:5846:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788842037.163004:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8d3a48e21e00:6696] 2 exiting: rc = 0 00000100:00100000:0.0:1788842037.164126:0:8622:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8d3a765a2600:8622] 3 exiting: rc = 0 00000100:00100000:3.0:1788842037.165806:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8d3a76108000:6693] 0 exiting: rc = 1 00000100:00100000:0.0:1788842037.166502:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166510:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166518:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166525:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166530:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166535:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166540:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166544:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166549:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166553:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166558:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166563:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166567:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166573:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166579:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166584:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166590:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166595:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166600:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166606:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166611:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166617:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166622:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166830:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166835:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166840:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166844:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166849:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166854:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166860:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166864:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166869:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166875:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166881:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166888:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166894:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166898:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166903:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166907:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166912:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166917:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166922:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166927:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.166931:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.167323:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.167331:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.167337:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.167342:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.167347:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.167353:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.167359:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.167374:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.167380:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.167386:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.167391:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.167405:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.167413:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.167419:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.167432:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.167441:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.167447:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.167453:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.167458:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.167463:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788842037.170646:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8d3a49933800:6697] 0 exiting: rc = 1 00000100:00100000:3.0:1788842037.171079:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8d3a49932000:6698] 1 exiting: rc = 0 00000100:00100000:0.0:1788842037.171180:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171189:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171195:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171200:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171205:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171210:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171215:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171221:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171227:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171232:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171236:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171242:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171258:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171264:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171269:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171274:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171279:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171285:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171291:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171295:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171301:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171305:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171309:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171315:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171320:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171326:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171331:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171337:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171342:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171376:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171382:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171388:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171393:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171399:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171404:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171409:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171414:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171419:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171424:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171429:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171436:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171444:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171451:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171457:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171463:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171467:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171472:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171477:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171484:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171489:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171494:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171499:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171504:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171511:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171518:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171523:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171528:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171534:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171538:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171543:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171549:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171554:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171559:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.171565:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.172469:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8d3a7c0b0600:6700] 1 exiting: rc = 0 00000100:00100000:3.0:1788842037.172741:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8d3a7c0b1e00:6699] 0 exiting: rc = 1 00000100:00100000:2.0:1788842037.172989:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8d3a7c11a000:6701] 2 exiting: rc = 0 00000100:00100000:0.0:1788842037.173101:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173109:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173114:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173120:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173126:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173132:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173138:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173144:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173149:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173155:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173161:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173167:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173172:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173178:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173184:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173189:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173195:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173200:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173206:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173212:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173218:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173225:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173243:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173251:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173257:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173263:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173269:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173275:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173281:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173288:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173294:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173301:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173307:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173312:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173335:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173341:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173350:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173356:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173375:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173382:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173388:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173394:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173400:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173406:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173413:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173419:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173426:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173432:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173438:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173445:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173451:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173456:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173477:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173483:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173489:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173495:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173501:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173506:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173512:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173518:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173524:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173530:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173536:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.173543:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788842037.181413:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8d3a434f5e00:6703] 1 exiting: rc = 0 00000100:00100000:2.0:1788842037.181562:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8d3a7c0b0e00:6702] 0 exiting: rc = 1 00000100:00100000:0.0:1788842037.181673:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.181681:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.181686:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.181691:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.181696:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.181927:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.181933:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.181938:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.181943:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.181948:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.181953:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.181958:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.181964:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.181969:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.181975:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.181980:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.181986:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.181991:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.181996:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182001:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182007:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182012:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182018:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182023:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182029:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182034:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182040:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182045:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182049:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182055:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182060:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182064:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182069:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182074:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182079:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182084:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182088:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182094:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182099:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182104:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182117:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182123:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182127:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182132:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182137:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182145:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182152:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182157:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182161:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182166:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182172:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182177:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182182:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182187:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182193:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182198:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182203:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182207:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182213:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182218:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182223:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182227:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182232:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.182237:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788842037.183336:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8d3a75f35e00:6704] 0 exiting: rc = 1 00000100:00100000:2.0:1788842037.183465:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8d3a76152000:6705] 1 exiting: rc = 0 00000100:00100000:0.0:1788842037.183585:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183594:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183601:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183607:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183614:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183621:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183627:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183632:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183638:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183656:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183663:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183681:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183686:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183693:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183699:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183704:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183904:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183912:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183918:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183924:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183931:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183952:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183961:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183973:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183979:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183986:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183992:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.183998:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184004:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184010:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184019:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184031:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184039:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184061:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184069:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184074:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184080:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184087:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184092:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184099:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184105:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184111:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184119:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184125:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184138:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184160:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184174:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184181:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184188:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184194:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184202:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184207:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184213:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184220:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184226:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184232:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184238:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184260:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184267:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184273:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184279:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184286:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184292:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788842037.184298:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788842037.198601:0:13263:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788842054.617153:0:13879:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788842063.290320:0:14340:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788842063.290325:0:14340:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788842063.290442:0:14340:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d3a4fa2d800 00000020:01000004:3.0:1788842063.290459:0:14340:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788842063.290468:0:14340:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788842063.290481:0:14340:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8d3a75ddb370) 00000020:00000080:3.0:1788842063.290495:0:14340:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788842063.307382:0:14340:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788842063.310037:0:14340:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788842063.310464:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 527: rc = 0 00100000:10000000:2.0:1788842063.310656:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 527: rc = 0 00100000:10000000:2.0:1788842063.310957:0:14340:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788842063.311030:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 527: rc = 0 00100000:10000000:2.0:1788842063.311131:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 527: rc = 0 00100000:10000000:2.0:1788842063.311314:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 527: rc = 0 00100000:10000000:2.0:1788842063.311412:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 527: rc = 0 00100000:10000000:3.0:1788842063.312056:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 529: rc = 0 00100000:10000000:3.0:1788842063.313440:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 212: rc = 0 00100000:10000000:3.0:1788842063.313632:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 212: rc = 0 00100000:10000000:3.0:1788842063.314304:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 670: rc = 0 00100000:10000000:3.0:1788842063.314639:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 670: rc = 0 00100000:10000000:3.0:1788842063.315064:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 670: rc = 0 00100000:10000000:3.0:1788842063.315401:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 670: rc = 0 00100000:10000000:3.0:1788842063.315753:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 670: rc = 0 00100000:10000000:3.0:1788842063.316087:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 670: rc = 0 00100000:10000000:3.0:1788842063.316432:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 670: rc = 0 00100000:10000000:3.0:1788842063.317633:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 670: rc = 0 00100000:10000000:3.0:1788842063.318026:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 670: rc = 0 00100000:10000000:3.0:1788842063.318373:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 670: rc = 0 00100000:10000000:3.0:1788842063.318819:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 670: rc = 0 00100000:10000000:3.0:1788842063.319245:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 670: rc = 0 00100000:10000000:3.0:1788842063.319794:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 234: rc = 0 00100000:10000000:3.0:1788842063.320250:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 234: rc = 0 00100000:10000000:3.0:1788842063.320497:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 234: rc = 0 00100000:10000000:3.0:1788842063.321058:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 234: rc = 0 00100000:10000000:3.0:1788842063.321418:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 234: rc = 0 00100000:10000000:3.0:1788842063.321790:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 234: rc = 0 00100000:10000000:3.0:1788842063.322129:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 234: rc = 0 00100000:10000000:3.0:1788842063.322461:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 234: rc = 0 00100000:10000000:3.0:1788842063.322791:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 234: rc = 0 00100000:10000000:3.0:1788842063.323340:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 234: rc = 0 00100000:10000000:3.0:1788842063.323673:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 234: rc = 0 00100000:10000000:3.0:1788842063.324037:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 234: rc = 0 00100000:10000000:3.0:1788842063.324391:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 234: rc = 0 00100000:10000000:3.0:1788842063.325262:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 234: rc = 0 00100000:10000000:3.0:1788842063.325576:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 234: rc = 0 00100000:10000000:3.0:1788842063.325834:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 234: rc = 0 00100000:10000000:3.0:1788842063.326230:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 234: rc = 0 00100000:10000000:3.0:1788842063.326483:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 234: rc = 0 00100000:10000000:3.0:1788842063.326952:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 234: rc = 0 00100000:10000000:3.0:1788842063.327242:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 234: rc = 0 00100000:10000000:3.0:1788842063.329423:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 234: rc = 0 00100000:10000000:3.0:1788842063.329839:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 234: rc = 0 00100000:10000000:3.0:1788842063.330265:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 234: rc = 0 00100000:10000000:3.0:1788842063.330616:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 234: rc = 0 00100000:10000000:3.0:1788842063.331097:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 234: rc = 0 00100000:10000000:3.0:1788842063.331687:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 234: rc = 0 00100000:10000000:3.0:1788842063.332076:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 234: rc = 0 00100000:10000000:3.0:1788842063.332434:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 234: rc = 0 00100000:10000000:3.0:1788842063.332852:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 234: rc = 0 00100000:10000000:3.0:1788842063.333338:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 234: rc = 0 00100000:10000000:3.0:1788842063.333687:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 234: rc = 0 00100000:10000000:3.0:1788842063.334081:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 234: rc = 0 00100000:10000000:3.0:1788842063.334651:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 678: rc = 0 00100000:10000000:2.0:1788842063.335746:0:14340:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788842063.336028:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 213: rc = 0 00100000:10000000:2.0:1788842063.336313:0:14340:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788842063.336385:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 213: rc = 0 00100000:10000000:2.0:1788842063.337005:0:14340:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788842063.337084:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 213: rc = 0 00100000:10000000:2.0:1788842063.337492:0:14340:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788842063.337578:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 318: rc = 0 00100000:10000000:2.0:1788842063.337809:0:14340:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788842063.337895:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 318: rc = 0 00100000:10000000:2.0:1788842063.338090:0:14340:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788842063.338151:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 318: rc = 0 00000020:00000080:2.0:1788842063.338433:0:14340:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788842063.338442:0:14340:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788842063.338453:0:14340:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3de1064d33a8c0cb 00000020:01000004:2.0:1788842063.338463:0:14340:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788842063.338468:0:14340:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788842063.338474:0:14340:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d3a4fa2d800 from MGS 00000020:01000004:2.0:1788842063.338477:0:14340:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788842063.339202:0:14340:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8d3a7c108000) 00000020:00000080:2.0:1788842063.339221:0:14340:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788842063.339290:0:14340:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d3a4fa2d800 from MGS, refs=2 00080000:01000000:2.0:1788842063.339295:0:14340:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788842063.339312:0:14340:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3de1064d33a8c0d9 00000100:00100000:2.0:1788842063.339442:0:14340:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788842063.339690:0:14340:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788842063.339697:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788842063.340395:0:14340:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788842063.340403:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788842063.341255:0:14340:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788842063.341461:0:14340:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788842063.341467:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788842063.342117:0:14340:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788842063.342124:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788842063.342492:0:14340:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788842063.342498:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788842063.343154:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842063.343158:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842063.343160:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842063.343426:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842063.343429:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842063.343430:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842063.343999:0:14340:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788842063.346964:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788842063.355425:0:14340:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788842063.355443:0:14340:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788842063.355445:0:14340:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788842063.358245:0:14349:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788842063.358420:0:14340:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788842063.358939:0:14340:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788842063.360618:0:14340:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788842063.362275:0:14340:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788842063.362479:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788842063.362485:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788842063.365335:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788842063.365347:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788842063.365970:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788842063.365978:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788842063.367017:0:14340:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788842063.367041:0:14340:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.155@tcp' 00000020:01000004:2.0:1788842063.367043:0:14340:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788842063.367075:0:14340:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.155@tcp (typ=mgc) 00000020:00000080:2.0:1788842063.367088:0:14340:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.155@tcp (ffff8d3a7c10b370) 00000020:00000080:2.0:1788842063.367105:0:14340:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:0.0:1788842063.367293:0:14353:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:2.0:1788842063.367618:0:14340:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d3a5819b800@MGC192.168.204.155@tcp: add connection 192.168.204.155@tcp at head 00010000:00010000:2.0:1788842063.368440:0:14340:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.155@tcp-0 is initialized 00000040:01000000:2.0:1788842063.368449:0:14340:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.155@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788842063.369106:0:14354:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788842063.369246:0:14340:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.155@tcp (uuid 6792fa91-218c-4171-b8ed-40bcd3d71b04) 00000020:00000080:2.0:1788842063.369265:0:14340:0:(genops.c:1385:class_connect()) connect: client 6792fa91-218c-4171-b8ed-40bcd3d71b04, cookie 0x3de1064d33a8c0e7 00000100:00080000:2.0:1788842063.369278:0:14340:0:(import.c:510:import_select_connection()) MGC192.168.204.155@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788842063.369289:0:14340:0:(import.c:624:import_select_connection()) MGC192.168.204.155@tcp: import ffff8d3a5819b800 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:2.0:1788842063.369322:0:14340:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3a49adc380 x1875736500722176/t0(0) o250->MGC192.168.204.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788842063.369452:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6792fa91-218c-4171-b8ed-40bcd3d71b04:3306:1875736500722176:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788842063.369611:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842063.369809:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500722176 00000100:00100000:3.0:1788842063.369817:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500722176 00000100:00100000:3.0:1788842063.369855:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788842063.369877:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d394479b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3306:x1875736500722176:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788842063.369901:0:14351:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 6792fa91-218c-4171-b8ed-40bcd3d71b04@0@lo t0 exp 0000000000000000 cur 391 last 0 00000020:00000080:3.0:1788842063.369923:0:14351:0:(genops.c:1385:class_connect()) connect: client 6792fa91-218c-4171-b8ed-40bcd3d71b04, cookie 0x3de1064d33a8c0ee 00000100:00080000:3.0:1788842063.370054:0:14351:0:(import.c:65:import_set_state_nolock()) ffff8d3a4fa2e800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788842063.370138:0:14340:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6792fa91-218c-4171-b8ed-40bcd3d71b04->MGS 00000020:01000004:2.0:1788842063.370160:0:14340:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788842063.370181:0:14340:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788842063.370197:0:14340:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8d3a7c1099b8) 00000020:00000080:2.0:1788842063.370209:0:14340:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788842063.373276:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d394479b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+5:3306:x1875736500722176:12345-0@lo:250:mount.lustre.0 Request processed in 3386us (3652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842063.373292:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788842063.376662:0:3306:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.155@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788842063.376681:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.155@tcp: connect to target with instance 0 00000100:00080000:0.0:1788842063.376690:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.155@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788842063.376704:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788842063.376791:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8d3a5819b800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788842063.376796:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788842063.376872:0:3306:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788842063.376882:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6792fa91-218c-4171-b8ed-40bcd3d71b04:3306:1875736500722176:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788842063.378006:0:14340:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788842063.379344:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788842063.379353:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788842063.385111:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788842063.385128:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788842063.387997:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788842063.388011:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788842063.393041:0:14340:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788842063.393305:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788842063.393312:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788842063.395389:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788842063.395400:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788842063.438417:0:14340:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788842063.439305:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788842063.439314:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788842063.440584:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788842063.440598:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788842063.441330:0:14340:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788842063.441608:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788842063.441614:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788842063.442341:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788842063.442348:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788842063.443395:0:14340:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788842063.443659:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788842063.443666:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788842063.444333:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788842063.444340:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788842063.445075:0:14340:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788842063.445333:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788842063.445339:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788842063.445935:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788842063.445942:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788842063.462847:0:14340:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788842063.463105:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788842063.463112:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788842063.464456:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788842063.464467:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788842063.465233:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788842063.465243:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788842063.466222:0:14340:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788842063.466248:0:14340:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788842063.466255:0:14340:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.155@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788842063.466387:0:14340:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.155@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788842063.466422:0:14340:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.155@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788842063.466428:0:14340:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788842063.466430:0:14340:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788842063.466431:0:14340:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788842063.466433:0:14340:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788842063.466434:0:14340:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788842063.466435:0:14340:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788842063.466436:0:14340:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788842063.466437:0:14340:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788842063.466444:0:14340:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788842063.466445:0:14340:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788842063.466447:0:14340:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788842063.466449:0:14340:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788842063.466450:0:14340:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788842063.466451:0:14340:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788842063.466452:0:14340:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788842063.466453:0:14340:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788842063.466454:0:14340:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788842063.466455:0:14340:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788842063.466456:0:14340:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788842063.466456:0:14340:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788842063.466457:0:14340:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788842063.466498:0:14340:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788842063.466598:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500722304:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788842063.466678:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842063.466853:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e4e9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788842063.467021:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500722304 00000100:00100000:1.0:1788842063.467028:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500722304 00000100:00100000:1.0:1788842063.467109:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788842063.467119:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3944798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+5:14340:x1875736500722304:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788842063.467174:0:14352:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788842063.467177:0:14352:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788842063.467180:0:14352:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788842063.467455:0:14374:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788842063.467847:0:14352:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1788842063.468798:0:14375:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788842063.468804:0:14375:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788842063.468807:0:14375:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788842063.468840:0:14375:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788842063.469133:0:14352:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788842063.469143:0:14352:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788842063.475908:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3944798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+5:14340:x1875736500722304:12345-0@lo:253:mount.lustre.0 Request processed in 8780us (9220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842063.475925:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788842063.476013:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500722304:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788842063.476029:0:14340:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788842063.476033:0:14340:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788842063.476034:0:14340:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788842063.476036:0:14340:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788842063.476037:0:14340:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788842063.476038:0:14340:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788842063.476040:0:14340:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788842063.476041:0:14340:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788842063.476043:0:14340:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788842063.476044:0:14340:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788842063.476046:0:14340:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788842063.476066:0:14340:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d3a4fa2d800 from lustre-MDT0000 10000000:01000000:3.0:1788842063.476096:0:14340:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788842063.476099:0:14340:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788842063.476103:0:14340:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d3a7c10b370 10000000:01000000:3.0:1788842063.476107:0:14340:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788842063.476114:0:14340:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d3a7c10b370 from 1 10000000:01000000:3.0:1788842063.476117:0:14340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788842063.476239:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8c0fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842063.476251:0:14340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8c0fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842063.476261:0:14340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8c0fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842063.476637:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500722432:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788842063.476680:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842063.476756:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e4e9900 going to sleep for 11 seconds 00000100:00100000:0.0:1788842063.476915:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500722432 00000100:00100000:0.0:1788842063.476923:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500722432 00000100:00100000:0.0:1788842063.476968:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788842063.476978:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3944799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+5:14340:x1875736500722432:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788842063.476991:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842063.477013:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c78fc00/0x3de1064d33a8c103 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8c0fc expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842063.477038:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c78fc00/0x3de1064d33a8c103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8c0fc expref: 6 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842063.477049:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c78fc00/0x3de1064d33a8c103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c0fc expref: 6 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842063.477058:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78fc00, rc 0) 00000100:00100000:0.0:1788842063.477188:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3944799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+6:14340:x1875736500722432:12345-0@lo:101:mount.lustre.0 Request processed in 211us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842063.477195:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788842063.477367:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500722432:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788842063.477385:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8c0fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c103 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.477394:0:14340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8c0fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8c103 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842063.477448:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500722560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788842063.477484:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842063.477610:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788842063.477651:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500722560 00000100:00100000:1.0:1788842063.477657:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500722560 00000100:00100000:1.0:1788842063.477758:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788842063.477767:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d394479a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+6:14340:x1875736500722560:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788842063.478002:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d394479a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+6:14340:x1875736500722560:12345-0@lo:501:mount.lustre.0 Request processed in 236us (516us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788842063.478009:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788842063.478071:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500722560:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788842063.478102:0:14340:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788842063.478122:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8c0fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c103 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.478139:0:14340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8c0fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c103 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788842063.478148:0:14340:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d3a4fa2d800 10000000:01000000:2.0:1788842063.478152:0:14340:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788842063.478156:0:14340:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d3a4fa2d800 10000000:01000000:2.0:1788842063.478159:0:14340:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788842063.478162:0:14340:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d3a4fa2d800 from 1 10000000:01000000:2.0:1788842063.478164:0:14340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788842063.478185:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cc200/0x3de1064d33a8c10a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.478192:0:14340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cc200/0x3de1064d33a8c10a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.478200:0:14340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cc200/0x3de1064d33a8c10a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842063.478211:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500722688:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788842063.478247:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842063.478418:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788842063.478478:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500722688 00000100:00100000:3.0:1788842063.478483:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500722688 00000100:00100000:3.0:1788842063.478577:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788842063.478587:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3944798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+6:14340:x1875736500722688:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788842063.478596:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842063.478610:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a60053000/0x3de1064d33a8c111 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8c10a expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842063.478626:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a60053000/0x3de1064d33a8c111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8c10a expref: 7 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842063.478635:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a60053000/0x3de1064d33a8c111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c10a expref: 7 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842063.478641:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60053000, rc 0) 00000100:00100000:3.0:1788842063.478681:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3944798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+7:14340:x1875736500722688:12345-0@lo:101:mount.lustre.0 Request processed in 96us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842063.478687:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788842063.478790:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500722688:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788842063.478810:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cc200/0x3de1064d33a8c10a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c111 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.478818:0:14340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cc200/0x3de1064d33a8c10a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8c111 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788842063.478832:0:14340:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788842063.478848:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cc200/0x3de1064d33a8c10a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c111 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.478864:0:14340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cc200/0x3de1064d33a8c10a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c111 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788842063.478871:0:14340:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788842063.478875:0:14340:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788842063.478880:0:14340:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d3a4fa2d800 10000000:01000000:2.0:1788842063.478882:0:14340:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788842063.478885:0:14340:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788842063.478888:0:14340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788842063.478902:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cd800/0x3de1064d33a8c118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.478909:0:14340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cd800/0x3de1064d33a8c118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.478916:0:14340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cd800/0x3de1064d33a8c118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842063.478928:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500722816:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788842063.478962:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842063.478981:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788842063.479040:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500722816 00000100:00100000:3.0:1788842063.479045:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500722816 00000100:00100000:3.0:1788842063.479063:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788842063.479069:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3944799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+7:14340:x1875736500722816:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788842063.479076:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842063.479084:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a60052800/0x3de1064d33a8c11f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8c118 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842063.479098:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a60052800/0x3de1064d33a8c11f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8c118 expref: 8 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842063.479105:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a60052800/0x3de1064d33a8c11f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c118 expref: 8 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842063.479111:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60052800, rc 0) 00000100:00100000:3.0:1788842063.479214:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3944799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+8:14340:x1875736500722816:12345-0@lo:101:mount.lustre.0 Request processed in 144us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842063.479220:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788842063.479294:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500722816:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788842063.479306:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cd800/0x3de1064d33a8c118 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c11f expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.479314:0:14340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cd800/0x3de1064d33a8c118 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8c11f expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842063.479356:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500722944:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788842063.479381:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842063.479400:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788842063.479448:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500722944 00000100:00100000:3.0:1788842063.479452:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500722944 00000100:00100000:3.0:1788842063.479467:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788842063.479473:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d394479bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+8:14340:x1875736500722944:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788842063.480061:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d394479bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+9:14340:x1875736500722944:12345-0@lo:501:mount.lustre.0 Request processed in 586us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842063.480070:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788842063.480246:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500722944:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788842063.480278:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500723072:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788842063.480316:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842063.480373:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788842063.480412:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500723072 00000100:00100000:1.0:1788842063.480417:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500723072 00000100:00100000:1.0:1788842063.480484:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788842063.480493:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d394479ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+9:14340:x1875736500723072:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788842063.481236:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d394479ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+9:14340:x1875736500723072:12345-0@lo:503:mount.lustre.0 Request processed in 742us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842063.481245:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788842063.481392:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500723072:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788842063.481973:0:14376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6792fa91-218c-4171-b8ed-40bcd3d71b04:14376:1875736500723200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788842063.482016:0:14376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842063.482378:0:14376:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7611cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788842063.482635:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500723200 00000100:00100000:3.0:1788842063.482642:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500723200 00000100:00100000:3.0:1788842063.482682:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788842063.482690:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d394479a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+9:14376:x1875736500723200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788842063.483098:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d394479a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+9:14376:x1875736500723200:12345-0@lo:502:llog_process_th.0 Request processed in 407us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842063.483106:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788842063.483286:0:14376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6792fa91-218c-4171-b8ed-40bcd3d71b04:14376:1875736500723200:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788842063.483322:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788842063.483334:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788842063.483336:0:14376:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788842063.483342:0:14376:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788842063.483433:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788842063.483448:0:14376:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8d3a7c10cd28) 00000020:00000080:2.0:1788842063.483468:0:14376:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788842063.483474:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788842063.483694:0:14376:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788842063.483702:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3de1064d33a8c12d 00000020:00000080:2.0:1788842063.484100:0:14376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788842063.484105:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788842063.484110:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788842063.484112:0:14376:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788842063.484114:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788842063.484120:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788842063.484121:0:14376:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788842063.484124:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788842063.484211:0:14376:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8d3a435699b8) 00000020:00000080:2.0:1788842063.484225:0:14376:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788842063.484230:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788842063.484232:0:14376:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788842063.484236:0:14376:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788842063.484242:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788842063.484286:0:14376:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d3a4fa2d800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788842063.484300:0:14376:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8d3a4356cd28) 00000020:00000080:2.0:1788842063.484308:0:14376:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788842063.484458:0:14376:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788842063.484466:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3de1064d33a8c142 00000020:00000080:2.0:1788842063.484734:0:14376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788842063.484742:0:14376:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788842063.484747:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3de1064d33a8c149 00080000:01000000:2.0:1788842063.484752:0:14376:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788842063.484756:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3de1064d33a8c150 00010000:00010000:1.0:1788842063.575666:0:14376:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788842063.576253:0:14376:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1788842063.576441:0:14376:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788842063.577292:0:14376:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8d39462eb370) 00000020:00000080:1.0:1788842063.577312:0:14376:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788842063.577394:0:14376:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788842063.577402:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3de1064d33a8c15e 00000020:00000080:0.0:1788842063.578114:0:14376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788842063.582021:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3de1064d33a8c165 00000020:00000080:2.0:1788842063.585756:0:14376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788842063.585772:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788842063.585780:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788842063.585787:0:14376:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788842063.585792:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788842063.585794:0:14376:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1788842063.585796:0:14376:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788842063.585797:0:14376:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788842063.585799:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788842063.585802:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788842063.585803:0:14376:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788842063.585806:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788842063.585810:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788842063.585812:0:14376:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788842063.585816:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788842063.585872:0:14376:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788842063.585886:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788842063.585890:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788842063.585891:0:14376:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788842063.585894:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788842063.585897:0:14376:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788842063.585901:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788842063.585902:0:14376:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788842063.585905:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788842063.585910:0:14376:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.155@tcp to nid 0x20000c0a8cc9b (192.168.204.155@tcp) 00000020:01000000:2.0:1788842063.585939:0:14376:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788842063.585943:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788842063.585960:0:14376:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d3a4356b370) 00000020:00000080:2.0:1788842063.585977:0:14376:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788842063.585982:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788842063.586030:0:14376:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788842063.586036:0:14376:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788842063.586043:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3de1064d33a8c173 00010000:00080000:2.0:1788842063.586071:0:14376:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d3a6fbe8800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.155@tcp at head 00010000:00010000:2.0:1788842063.587931:0:14376:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788842063.591100:0:14376:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788842063.592341:0:14376:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788842063.595985:0:14376:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788842063.596072:0:14376:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788842063.596667:0:14376:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788842063.598475:0:14380:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788842063.598482:0:14380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788842063.600360:0:14376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788842063.600381:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788842063.600439:0:14376:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788842063.600468:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3de1064d33a8c17a 00000100:00080000:1.0:1788842063.600482:0:14376:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788842063.600489:0:14376:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d3a6fbe8800 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:1.0:1788842063.600544:0:14376:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3a412a8a80 x1875736500723328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788842063.600897:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875736500723328:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788842063.600959:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875736500723328 offset 0 length 520: 4 00000100:00080000:1.0:1788842063.601042:0:14376:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788842063.601125:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788842063.601142:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788842063.601144:0:14376:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788842063.601148:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788842063.601150:0:14376:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788842063.601152:0:14376:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788842063.601154:0:14376:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788842063.601155:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788842063.601158:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788842063.601159:0:14376:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788842063.601162:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788842063.601166:0:14376:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788842063.601169:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788842063.601170:0:14376:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788842063.601173:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788842063.601177:0:14376:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.155@tcp to nid 0x20000c0a8cc9b (192.168.204.155@tcp) 00000020:01000000:1.0:1788842063.601203:0:14376:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788842063.601206:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788842063.601223:0:14376:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d39462ecd28) 00000020:00000080:1.0:1788842063.601240:0:14376:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788842063.601245:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788842063.601313:0:14376:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788842063.601318:0:14376:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788842063.601324:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3de1064d33a8c188 00010000:00080000:1.0:1788842063.601351:0:14376:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d3a6fbee000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.155@tcp at head 00010000:00010000:1.0:1788842063.601641:0:14376:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788842063.601909:0:14376:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788842063.601934:0:14376:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788842063.602568:0:14376:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788842063.602636:0:14376:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788842063.602735:0:14376:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788842063.604314:0:14382:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788842063.604321:0:14382:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788842063.605563:0:14376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788842063.605584:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788842063.605617:0:14376:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788842063.605635:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3de1064d33a8c18f 00000100:00080000:2.0:1788842063.605646:0:14376:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788842063.605652:0:14376:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d3a6fbee000 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:2.0:1788842063.605686:0:14376:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3a49adca80 x1875736500723456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788842063.606103:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875736500723456:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788842063.606167:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875736500723456 offset 0 length 520: 4 00000100:00080000:0.0:1788842063.606638:0:14376:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788842063.606775:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788842063.606781:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788842063.606783:0:14376:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788842063.606787:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788842063.606791:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788842063.606792:0:14376:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788842063.606796:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788842063.606798:0:14376:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788842063.606801:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788842063.606803:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788842063.606804:0:14376:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788842063.606807:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788842063.606809:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788842063.606810:0:14376:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788842063.606813:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788842063.606845:0:14376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76806d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6792fa91-218c-4171-b8ed-40bcd3d71b04:14376:1875736500723584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788842063.606912:0:14376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842063.606944:0:14376:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a44f12900 going to sleep for 11 seconds 00000100:00100000:3.0:1788842063.607018:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500723584 00000100:00100000:3.0:1788842063.607025:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500723584 00000100:00100000:3.0:1788842063.607073:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788842063.607082:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3944799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+9:14376:x1875736500723584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788842063.607421:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3944799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+9:14376:x1875736500723584:12345-0@lo:502:llog_process_th.0 Request processed in 339us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842063.607429:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788842063.607521:0:14376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76806d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6792fa91-218c-4171-b8ed-40bcd3d71b04:14376:1875736500723584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788842063.607545:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788842063.607549:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788842063.607551:0:14376:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788842063.607554:0:14376:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788842063.607763:0:14340:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1788842063.607779:0:14340:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788842063.607796:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cd800/0x3de1064d33a8c118 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c11f expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842063.607807:0:14340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cd800/0x3de1064d33a8c118 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c11f expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788842063.607816:0:14340:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d3a4fa2d800 from 1 10000000:01000000:0.0:1788842063.607818:0:14340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788842063.607845:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842063.607866:0:14340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842063.607877:0:14340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842063.607892:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76806d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500723712:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788842063.607923:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842063.607947:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a44f12900 going to sleep for 11 seconds 00000100:00100000:0.0:1788842063.607964:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500723712 00000100:00100000:0.0:1788842063.607968:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500723712 00000100:00100000:0.0:1788842063.607997:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788842063.608003:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+9:14340:x1875736500723712:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788842063.608012:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842063.608024:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c78ec00/0x3de1064d33a8c19d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8c196 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842063.608044:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c78ec00/0x3de1064d33a8c19d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8c196 expref: 10 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842063.608054:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c78ec00/0x3de1064d33a8c19d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c196 expref: 10 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842063.608062:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78ec00, rc 0) 00000100:00100000:0.0:1788842063.608089:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+10:14340:x1875736500723712:12345-0@lo:101:mount.lustre.0 Request processed in 86us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842063.608095:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788842063.608199:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76806d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500723712:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788842063.608212:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c196 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c19d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842063.608221:0:14340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c196 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8c19d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842063.609011:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76806d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500723840:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788842063.609062:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842063.609101:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a44f12900 going to sleep for 11 seconds 00000100:00100000:1.0:1788842063.609298:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500723840 00000100:00100000:1.0:1788842063.609304:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500723840 00000100:00100000:1.0:1788842063.609346:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788842063.609354:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+10:14340:x1875736500723840:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788842063.609371:0:14351:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788842063.609377:0:14351:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788842063.609448:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+10:14340:x1875736500723840:12345-0@lo:256:mount.lustre.0 Request processed in 94us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842063.609455:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788842063.609657:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76806d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500723840:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788842063.611549:0:14340:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788842063.611763:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c196 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c19d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842063.611777:0:14340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c19d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788842063.611788:0:14340:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3a4fa2d800 from 1 10000000:01000000:0.0:1788842063.611790:0:14340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788842063.611832:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e600/0x3de1064d33a8c1a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842063.611841:0:14340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e600/0x3de1064d33a8c1a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842063.611860:0:14340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e600/0x3de1064d33a8c1a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842063.611886:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76806d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500723968:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788842063.611949:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842063.611989:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a44f12900 going to sleep for 11 seconds 00000100:00100000:0.0:1788842063.612034:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500723968 00000100:00100000:0.0:1788842063.612041:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500723968 00000100:00100000:0.0:1788842063.612081:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788842063.612091:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+10:14340:x1875736500723968:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788842063.612103:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842063.612116:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c78e800/0x3de1064d33a8c1ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8c1a4 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842063.612347:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c78e800/0x3de1064d33a8c1ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8c1a4 expref: 11 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842063.612371:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c78e800/0x3de1064d33a8c1ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c1a4 expref: 11 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842063.612380:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78e800, rc 0) 00000100:00100000:0.0:1788842063.612430:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+11:14340:x1875736500723968:12345-0@lo:101:mount.lustre.0 Request processed in 340us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842063.612436:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788842063.612836:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76806d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500723968:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788842063.612863:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e600/0x3de1064d33a8c1a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c1ab expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.612873:0:14340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e600/0x3de1064d33a8c1a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8c1ab expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842063.612931:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500724096:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788842063.612962:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842063.612983:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a6a08ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788842063.613070:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500724096 00000100:00100000:0.0:1788842063.613075:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500724096 00000100:00100000:0.0:1788842063.613110:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788842063.613118:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+11:14340:x1875736500724096:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788842063.613827:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+11:14340:x1875736500724096:12345-0@lo:501:mount.lustre.0 Request processed in 708us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842063.613837:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788842063.613936:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500724096:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788842063.613973:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500724224:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788842063.614012:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842063.614048:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a6a08ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788842063.614096:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500724224 00000100:00100000:0.0:1788842063.614102:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500724224 00000100:00100000:0.0:1788842063.614173:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788842063.614182:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+11:14340:x1875736500724224:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788842063.614338:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+11:14340:x1875736500724224:12345-0@lo:503:mount.lustre.0 Request processed in 157us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842063.614346:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788842063.614414:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500724224:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788842063.615279:0:14384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6792fa91-218c-4171-b8ed-40bcd3d71b04:14384:1875736500724352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788842063.615330:0:14384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842063.615400:0:14384:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a6a08ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788842063.615437:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500724352 00000100:00100000:0.0:1788842063.615444:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500724352 00000100:00100000:0.0:1788842063.615520:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788842063.615528:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+11:14384:x1875736500724352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788842063.615816:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+11:14384:x1875736500724352:12345-0@lo:502:llog_process_th.0 Request processed in 287us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842063.615830:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788842063.616058:0:14384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6792fa91-218c-4171-b8ed-40bcd3d71b04:14384:1875736500724352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788842063.616087:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788842063.616097:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788842063.616100:0:14384:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788842063.616106:0:14384:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d3a4fa2d800 00000020:00000080:2.0:1788842063.616109:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788842063.616117:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788842063.616119:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788842063.616120:0:14384:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788842063.616123:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788842063.616191:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788842063.616194:0:14384:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788842063.616200:0:14384:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d3a4fa2d800 00000020:00000080:2.0:1788842063.616202:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788842063.616263:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788842063.616267:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788842063.616269:0:14384:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788842063.616272:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788842063.616274:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788842063.616275:0:14384:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788842063.616278:0:14384:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d3a4fa2d800 00000020:00000080:2.0:1788842063.616280:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788842063.616318:0:14384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6792fa91-218c-4171-b8ed-40bcd3d71b04:14384:1875736500724480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788842063.616354:0:14384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842063.616389:0:14384:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7bc089c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788842063.617236:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500724480 00000100:00100000:3.0:1788842063.617243:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500724480 00000100:00100000:3.0:1788842063.617279:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788842063.617287:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+11:14384:x1875736500724480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788842063.617483:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+11:14384:x1875736500724480:12345-0@lo:502:llog_process_th.0 Request processed in 195us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842063.617491:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788842063.617754:0:14384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6792fa91-218c-4171-b8ed-40bcd3d71b04:14384:1875736500724480:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788842063.617787:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788842063.617793:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788842063.617795:0:14384:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788842063.617799:0:14384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788842063.617990:0:14340:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788842063.618006:0:14340:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788842063.618022:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e600/0x3de1064d33a8c1a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c1ab expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842063.618044:0:14340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e600/0x3de1064d33a8c1a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c1ab expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788842063.618086:0:14340:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788842063.618089:0:14340:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d3a4fa2d800 10000000:01000000:3.0:1788842063.618092:0:14340:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d3a4fa2d800 10000000:01000000:3.0:1788842063.618096:0:14340:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788842063.618101:0:14340:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d3a4fa2d800 from 1 10000000:01000000:3.0:1788842063.618104:0:14340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788842063.618821:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60052c00/0x3de1064d33a8c1b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842063.618834:0:14340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a60052c00/0x3de1064d33a8c1b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842063.618845:0:14340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a60052c00/0x3de1064d33a8c1b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842063.618878:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500724608:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788842063.618932:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842063.618969:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e4fee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788842063.618998:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500724608 00000100:00100000:3.0:1788842063.619005:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500724608 00000100:00100000:3.0:1788842063.619044:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788842063.619053:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+11:14340:x1875736500724608:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788842063.619065:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842063.619079:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8c1b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8c1b2 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842063.619117:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8c1b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8c1b2 expref: 12 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842063.619792:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a60053800/0x3de1064d33a8c1b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c1b2 expref: 12 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842063.619805:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60053800, rc 0) 00000100:00100000:3.0:1788842063.619914:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:14340:x1875736500724608:12345-0@lo:101:mount.lustre.0 Request processed in 861us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842063.619922:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788842063.630014:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500724608:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788842063.630044:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a60052c00/0x3de1064d33a8c1b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c1b9 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.630057:0:14340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a60052c00/0x3de1064d33a8c1b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8c1b9 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842063.630141:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500724736:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788842063.630206:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842063.630261:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7bc089c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788842063.630354:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500724736 00000100:00100000:0.0:1788842063.630361:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500724736 00000100:00100000:0.0:1788842063.630452:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788842063.630464:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:14340:x1875736500724736:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788842063.630850:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:14340:x1875736500724736:12345-0@lo:501:mount.lustre.0 Request processed in 387us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842063.630869:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788842063.636356:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500724736:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788842063.636424:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500724864:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788842063.636505:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842063.636558:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7bc089c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788842063.636655:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500724864 00000100:00100000:3.0:1788842063.636663:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500724864 00000100:00100000:3.0:1788842063.636731:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788842063.636742:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:14340:x1875736500724864:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788842063.641784:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:14340:x1875736500724864:12345-0@lo:503:mount.lustre.0 Request processed in 5034us (5269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842063.641801:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788842063.642025:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500724864:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788842063.645842:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6792fa91-218c-4171-b8ed-40bcd3d71b04:14390:1875736500724992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788842063.645960:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842063.646011:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e4e9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788842063.646098:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500724992 00000100:00100000:2.0:1788842063.646105:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500724992 00000100:00100000:2.0:1788842063.646239:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788842063.646250:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:14390:x1875736500724992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788842063.646544:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:14390:x1875736500724992:12345-0@lo:502:llog_process_th.0 Request processed in 295us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842063.646553:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788842063.647337:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6792fa91-218c-4171-b8ed-40bcd3d71b04:14390:1875736500724992:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788842063.647439:0:14390:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788842063.647464:0:14390:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8d3a75ddcd28) 00000020:00000080:3.0:1788842063.647497:0:14390:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788842063.648789:0:14390:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d3a4fa2d800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788842063.648798:0:14390:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d3a4fa2d800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788842063.648801:0:14390:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d3a4fa2d800 4 00010000:00080000:3.0:1788842063.648865:0:14390:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d3a75ee3800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.155@tcp at head 00010000:00010000:3.0:1788842063.653281:0:14390:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788842063.653473:0:14390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788842063.653514:0:14390:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788842063.653530:0:14390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3de1064d33a8c1c7 00000100:00080000:3.0:1788842063.653541:0:14390:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788842063.653547:0:14390:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d3a75ee3800 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:3.0:1788842063.655327:0:14390:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3a7c6a4380 x1875736500725120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788842063.655361:0:14390:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788842063.655678:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875736500725120:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788842063.655769:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842063.659778:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500725120 00000100:00100000:0.0:1788842063.659793:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500725120 00000100:00100000:0.0:1788842063.659836:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788842063.659846:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875736500725120:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788842063.659965:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875736500725120:12345-0@lo:38:llog_process_th.0 Request processed in 120us (4196us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788842063.659973:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788842063.660046:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788842063.660054:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8d3a75ee3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788842063.660059:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788842063.660063:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875736500725120:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788842063.661847:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6792fa91-218c-4171-b8ed-40bcd3d71b04:14390:1875736500725248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788842063.661946:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842063.661986:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500725248 00000100:00100000:3.0:1788842063.661993:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500725248 00000100:00100000:3.0:1788842063.662041:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788842063.662051:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:14390:x1875736500725248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788842063.663915:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:14390:x1875736500725248:12345-0@lo:502:llog_process_th.0 Request processed in 1857us (1961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842063.663928:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788842063.663992:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a463a4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788842063.664018:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6792fa91-218c-4171-b8ed-40bcd3d71b04:14390:1875736500725248:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788842063.664061:0:14390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788842063.664465:0:14340:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788842063.664492:0:14340:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788842063.664517:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60052c00/0x3de1064d33a8c1b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c1b9 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842063.664527:0:14340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a60052c00/0x3de1064d33a8c1b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c1b9 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788842063.664667:0:14340:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788842063.664669:0:14340:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788842063.664670:0:14340:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788842063.664672:0:14340:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788842063.664673:0:14340:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788842063.664674:0:14340:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788842063.664675:0:14340:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788842063.664677:0:14340:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788842063.664678:0:14340:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788842063.664680:0:14340:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788842063.664683:0:14340:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788842063.664686:0:14340:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788842063.664688:0:14340:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788842063.664689:0:14340:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788842063.664689:0:14340:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788842063.664690:0:14340:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788842063.664691:0:14340:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788842063.664692:0:14340:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788842063.664693:0:14340:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788842063.664694:0:14340:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788842063.664695:0:14340:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788842063.664737:0:14340:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788842063.664755:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76805c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500725376:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788842063.664805:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842063.664838:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e4fe3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788842063.664869:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500725376 00000100:00100000:0.0:1788842063.664876:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500725376 00000100:00100000:0.0:1788842063.664919:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788842063.664928:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:14340:x1875736500725376:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788842063.664969:0:14350:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788842063.664984:0:14350:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788842063.721476:0:14350:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788842063.721492:0:14350:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788842063.721825:0:14374:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788842063.721831:0:14374:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788842063.721884:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d3a7c78ee00/0x3de1064d33a8c1ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842063.721905:0:14374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a7c78ec00/0x3de1064d33a8c19d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c196 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842063.721914:0:14374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d3a7c78ee00/0x3de1064d33a8c1ce lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842063.721960:0:14374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a7c78ec00/0x3de1064d33a8c19d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8c196 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842063.721977:0:14374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d3a7c78ec00/0x3de1064d33a8c19d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8c196 expref: 12 pid: 14350 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842063.721993:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76806d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14374:1875736500725504:0@lo:104: 00000100:00100000:0.0:1788842063.722074:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842063.722178:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e096c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788842063.724337:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500725504 00000100:00100000:2.0:1788842063.724353:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500725504 00000100:00100000:2.0:1788842063.724410:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788842063.724424:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76807800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6792fa91-218c-4171-b8ed-40bcd3d71b04+3:14374:x1875736500725504:12345-0@lo:104: 00010000:00010000:2.0:1788842063.724444:0:14341:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8c19d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.724540:0:14341:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788842063.724547:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76807800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6792fa91-218c-4171-b8ed-40bcd3d71b04+3:14374:x1875736500725504:12345-0@lo:104: Request processed in 127us (2473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842063.724554:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788842063.724592:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788842063.724598:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8c19d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.724606:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78e200 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:2.0:1788842063.724610:0:14347:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8c19d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.724620:0:14347:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8c19d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788842063.724626:0:14347:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8c19d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788842063.724632:0:14347:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788842063.724685:0:14347:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c196 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8c19d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.724692:0:14347:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788842063.724729:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c196 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8c19d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.724737:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c196 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8c19d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.724753:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842063.724755:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842063.724757:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788842063.724781:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6792fa91-218c-4171-b8ed-40bcd3d71b04:3309:1875736500725632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788842063.724817:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842063.724915:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500725632 00000100:00100000:2.0:1788842063.724919:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500725632 00010000:00010000:2.0:1788842063.724938:0:14343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a7c78ec00/0x3de1064d33a8c19d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8c196 expref: 13 pid: 14350 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842063.724960:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788842063.724966:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49add500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6792fa91-218c-4171-b8ed-40bcd3d71b04+13:3309:x1875736500725632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788842063.724977:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788842063.724982:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a7c78ec00/0x3de1064d33a8c19d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8c196 expref: 13 pid: 14350 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.724992:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a7c78ec00/0x3de1064d33a8c19d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8c196 expref: 13 pid: 14350 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.725009:0:14343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d3a7c78ee00/0x3de1064d33a8c1ce lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.725024:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c78ee00/0x3de1064d33a8c1ce lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788842063.725039:0:14343:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003208239s 00010000:00010000:2.0:1788842063.725043:0:14343:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3a7c78ee00/0x3de1064d33a8c1ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.725051:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3a7c78ee00/0x3de1064d33a8c1ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.725058:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d3a7c78ee00/0x3de1064d33a8c1ce lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.725064:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d3a7c78ee00/0x3de1064d33a8c1ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.725069:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78ee00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:2.0:1788842063.725073:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d3a7c78ee00/0x3de1064d33a8c1ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.725080:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d3a7c78ee00/0x3de1064d33a8c1ce lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.725087:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d3a7c78ee00/0x3de1064d33a8c1ce lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.725097:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788842063.725195:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49add500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6792fa91-218c-4171-b8ed-40bcd3d71b04+13:3309:x1875736500725632:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842063.725203:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788842063.725248:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6792fa91-218c-4171-b8ed-40bcd3d71b04:3309:1875736500725632:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788842063.725286:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a7c78ec00/0x3de1064d33a8c19d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8c196 expref: 12 pid: 14350 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842063.725297:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76806d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14374:1875736500725504:0@lo:104: 00010000:00010000:2.0:1788842063.725312:0:14374:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d3a7c78ee00/0x3de1064d33a8c1ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.725323:0:14374:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d3a7c78ee00/0x3de1064d33a8c1ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.725329:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d3a7c78ee00/0x3de1064d33a8c1ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842063.725335:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a7c78ee00/0x3de1064d33a8c1ce lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842063.729685:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+11:14340:x1875736500725376:12345-0@lo:253:mount.lustre.0 Request processed in 64747us (64868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842063.729701:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788842063.729928:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76805c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:14340:1875736500725376:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788842063.729965:0:14340:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788842063.729969:0:14340:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788842063.729971:0:14340:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788842063.729972:0:14340:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788842063.729973:0:14340:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788842063.729975:0:14340:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788842063.729976:0:14340:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788842063.729978:0:14340:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788842063.729980:0:14340:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788842063.729983:0:14340:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788842063.729984:0:14340:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788842063.730000:0:14340:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788842063.736938:0:14340:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788842063.737100:0:14340:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788842063.737437:0:14340:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788842063.737674:0:14340:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788842063.737993:0:14340:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788842063.738228:0:14340:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788842063.739445:0:14340:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788842063.739686:0:14340:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788842063.740061:0:14340:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788842063.740379:0:14340:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788842063.740787:0:14340:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788842063.740969:0:14340:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788842063.767387:0:14340:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788842063.767972:0:14340:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788842063.768576:0:14398:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000020:00080000:3.0:1788842063.769339:0:14397:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788842063.769345:0:14397:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788842063.770496:0:14340:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788842063.770625:0:14340:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788842063.771079:0:14340:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788842063.771088:0:14340:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788842063.771219:0:14340:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788842063.772275:0:14398:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788842063.774278:0:14398:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788842063.774368:0:14398:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788842063.774373:0:14398:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1788842063.775381:0:14340:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788842063.776103:0:14340:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788842063.776225:0:14340:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1788842063.778483:0:14340:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1788842063.786131:0:14340:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788842063.822230:0:14340:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788842063.822285:0:14340:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffab9c81cfb988 00100000:10000000:1.0:1788842063.822295:0:14340:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788842063.823310:0:14340:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788842063.823326:0:14340:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.155@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788842063.823343:0:14340:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788842063.823379:0:14340:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788842064.393240:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788842064.706871:0:14354:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788842064.706889:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d3a4fa2d800 from 6 10000000:01000000:1.0:1788842064.706895:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788842064.706944:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24e400/0x3de1064d33a8c1d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842064.706958:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24e400/0x3de1064d33a8c1d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842064.706970:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24e400/0x3de1064d33a8c1d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842064.706997:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500725760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788842064.707072:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842064.707135:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a48d29a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788842064.707176:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500725760 00000100:00100000:1.0:1788842064.707183:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500725760 00000100:00100000:1.0:1788842064.707233:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788842064.707242:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+11:14354:x1875736500725760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788842064.707255:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788842064.707269:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c24fe00/0x3de1064d33a8c1dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8c1d5 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842064.707292:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c24fe00/0x3de1064d33a8c1dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8c1d5 expref: 12 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842064.707302:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c24fe00/0x3de1064d33a8c1dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c1d5 expref: 12 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842064.707312:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c24fe00, rc 0) 00000100:00100000:1.0:1788842064.707348:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:14354:x1875736500725760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842064.707361:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788842064.707407:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500725760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788842064.707425:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24e400/0x3de1064d33a8c1d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c1dc expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842064.707435:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24e400/0x3de1064d33a8c1d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8c1dc expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842064.707479:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500725888:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788842064.707871:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842064.707894:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a48d29a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788842064.707938:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500725888 00000100:00100000:0.0:1788842064.707942:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500725888 00000100:00100000:0.0:1788842064.707979:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788842064.707987:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:14354:x1875736500725888:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788842064.708001:0:14350:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788842064.708017:0:14350:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788842064.708020:0:14350:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788842064.708098:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:14354:x1875736500725888:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842064.708105:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788842064.708229:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500725888:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788842064.708266:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788842064.708273:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24e400/0x3de1064d33a8c1d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c1dc expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842064.708281:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24e400/0x3de1064d33a8c1d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c1dc expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788842064.709053:0:14389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788842065.409862:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788842065.730360:0:14389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788842066.433914:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842067.460768:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788842068.055091:0:14641:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788842068.482136:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788842069.121844:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788842069.121851:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788842069.121854:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788842069.121857:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788842069.121902:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788842069.121905:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788842069.121909:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d3a75ee3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788842069.121920:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d3a75ee3800 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:3.0:1788842069.121942:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3a7c6a7800 x1875736500726144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788842069.121983:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788842069.121998:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6792fa91-218c-4171-b8ed-40bcd3d71b04:3309:1875736500726016:0@lo:400:kworker.0 00000100:00100000:3.0:1788842069.122068:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842069.122128:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500726016 00000100:00100000:3.0:1788842069.122135:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500726016 00000100:00100000:3.0:1788842069.122181:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788842069.122190:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:3309:x1875736500726016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788842069.122238:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:3309:x1875736500726016:12345-0@lo:400:kworker.0 Request processed in 48us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842069.122245:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788842069.122291:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6792fa91-218c-4171-b8ed-40bcd3d71b04:3309:1875736500726016:0@lo:400:kworker.0 00000100:00100000:1.0:1788842069.124848:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875736500726144:0@lo:38:kworker.0 00000100:00100000:1.0:1788842069.124921:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842069.125031:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500726144 00000100:00100000:3.0:1788842069.125039:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500726144 00000100:00100000:3.0:1788842069.125081:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788842069.125089:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a412abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1875736500726144:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788842069.125118:0:14360:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 397 last 0 00000020:00000080:3.0:1788842069.125155:0:14360:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3de1064d33a8c1e3 00000004:00100000:3.0:1788842069.125170:0:14360:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788842069.125290:0:14360:0:(import.c:65:import_set_state_nolock()) ffff8d3a486f5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788842069.125351:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a412abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875736500726144:12345-0@lo:38:kworker.0 Request processed in 261us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842069.125359:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788842069.125396:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d3a7c6a7800 x1875736500726144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788842079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788842069.125411:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788842069.125428:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788842069.125432:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788842069.125435:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8d3a75ee3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788842069.125440:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875736500726144:0@lo:38:kworker.0 00010000:00010000:0.0:1788842069.509546:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842070.530008:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788842071.211418:0:14791:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec4b44c00 20000000:00000080:3.0:1788842071.211439:0:14791:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d3a444ae400 uarg=0000000000000000 20000000:01000000:3.0:1788842071.211474:0:14791:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788842071.211481:0:14791:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788842071.211485:0:14791:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788842071.212497:0:14792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1788842071.212654:0:14791:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788842071.219457:0:14791:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788842071.219490:0:14791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8c1ea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842071.219509:0:14791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a7c78e800/0x3de1064d33a8c1ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c1a4 expref: 11 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842071.219517:0:14791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8c1ea lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842071.219573:0:14791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a7c78e800/0x3de1064d33a8c1ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8c1a4 expref: 11 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842071.219588:0:14791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d3a7c78e800/0x3de1064d33a8c1ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8c1a4 expref: 11 pid: 14352 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842071.219602:0:14791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14791:1875736500726272:0@lo:104: 00000100:00100000:3.0:1788842071.219667:0:14791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842071.219765:0:14791:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a588afa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788842071.220214:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500726272 00000100:00100000:0.0:1788842071.220230:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500726272 00000100:00100000:0.0:1788842071.220280:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788842071.220290:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6792fa91-218c-4171-b8ed-40bcd3d71b04+3:14791:x1875736500726272:12345-0@lo:104: 00010000:00010000:0.0:1788842071.220304:0:14342:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e600/0x3de1064d33a8c1a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8c1ab expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842071.220373:0:14342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788842071.220380:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6792fa91-218c-4171-b8ed-40bcd3d71b04+3:14791:x1875736500726272:12345-0@lo:104: Request processed in 91us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842071.220387:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788842071.220406:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788842071.220411:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e600/0x3de1064d33a8c1a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8c1ab expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842071.220428:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78e600 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:0.0:1788842071.220432:0:14347:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e600/0x3de1064d33a8c1a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8c1ab expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842071.220440:0:14347:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e600/0x3de1064d33a8c1a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8c1ab expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788842071.220447:0:14347:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e600/0x3de1064d33a8c1a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8c1ab expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788842071.220452:0:14347:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788842071.220478:0:14347:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e600/0x3de1064d33a8c1a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8c1ab expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842071.220485:0:14347:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788842071.220506:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e600/0x3de1064d33a8c1a4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8c1ab expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842071.220512:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e600/0x3de1064d33a8c1a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8c1ab expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842071.220528:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842071.220530:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842071.220532:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788842071.220560:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6792fa91-218c-4171-b8ed-40bcd3d71b04:3307:1875736500726400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788842071.220588:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842071.220631:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500726400 00000100:00100000:0.0:1788842071.220635:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500726400 00010000:00010000:0.0:1788842071.220650:0:14343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a7c78e800/0x3de1064d33a8c1ab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8c1a4 expref: 12 pid: 14352 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842071.220677:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788842071.220684:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76807480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:3307:x1875736500726400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788842071.220694:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788842071.220698:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a7c78e800/0x3de1064d33a8c1ab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8c1a4 expref: 12 pid: 14352 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842071.220733:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a7c78e800/0x3de1064d33a8c1ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8c1a4 expref: 12 pid: 14352 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842071.220749:0:14343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8c1ea lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842071.220757:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8c1ea lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842071.220770:0:14343:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8c1ea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842071.220778:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8c1ea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842071.220785:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8c1ea lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842071.220791:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8c1ea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842071.220797:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053e00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:0.0:1788842071.220801:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8c1ea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842071.220815:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8c1ea lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842071.220825:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8c1ea lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842071.220836:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788842071.220864:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76807480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:3307:x1875736500726400:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842071.220883:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788842071.220918:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6792fa91-218c-4171-b8ed-40bcd3d71b04:3307:1875736500726400:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788842071.221274:0:14791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a7c78e800/0x3de1064d33a8c1ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8c1a4 expref: 11 pid: 14352 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842071.221286:0:14791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14791:1875736500726272:0@lo:104: 00010000:00010000:3.0:1788842071.221307:0:14791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8c1ea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842071.221315:0:14791:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8c1ea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842071.221322:0:14791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8c1ea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842071.221328:0:14791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8c1ea lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842071.555659:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788842072.579228:0:14354:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788842072.579236:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3a4fa2d800 from 10 10000000:01000000:0.0:1788842072.579241:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788842072.579291:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c1f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842072.579303:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c1f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842072.579315:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c1f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842072.579343:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76804000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500726528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788842072.579419:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842072.579485:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a48711f00 going to sleep for 11 seconds 00010000:00010000:0.0:1788842072.581622:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788842072.581700:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500726528 00000100:00100000:3.0:1788842072.581748:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500726528 00000100:00100000:3.0:1788842072.581815:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788842072.581825:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+11:14354:x1875736500726528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788842072.581843:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842072.581864:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8c1f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8c1f1 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842072.581894:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8c1f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8c1f1 expref: 12 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842072.581907:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8c1f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c1f1 expref: 12 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842072.581935:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60053e00, rc 0) 00000100:00100000:3.0:1788842072.582029:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:14354:x1875736500726528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (2609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842072.582037:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788842072.584842:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76804000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500726528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788842072.584873:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c1f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c1f8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842072.584902:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c1f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8c1f8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842072.584997:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500726656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788842072.585055:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842072.585102:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4ff719c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788842072.585222:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500726656 00000100:00100000:0.0:1788842072.585234:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500726656 00000100:00100000:0.0:1788842072.585286:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788842072.585294:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:14354:x1875736500726656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788842072.585551:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:14354:x1875736500726656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842072.585559:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788842072.586563:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500726656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788842072.586622:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500726784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788842072.586690:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842072.586746:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4ff719c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788842072.586828:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500726784 00000100:00100000:0.0:1788842072.586834:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500726784 00000100:00100000:0.0:1788842072.586878:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788842072.586886:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:14354:x1875736500726784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788842072.587582:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:14354:x1875736500726784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 634us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842072.587592:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788842072.588636:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500726784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788842072.589530:0:14843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788842072.589858:0:14354:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788842072.589881:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788842072.589893:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c1f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c1f8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842072.589906:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c1f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c1f8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842073.219635:0:3306:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788842063/real 1788842063] req@ffff8d3a49adca80 x1875736500723456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788842073 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788842073.219681:0:3306:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d3a49adca80 x1875736500723456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788842073 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788842073.219692:0:3306:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788842063/real 1788842063] req@ffff8d3a412a8a80 x1875736500723328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788842073 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788842073.219703:0:3306:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d3a412a8a80 x1875736500723328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788842073 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788842073.219745:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8d3a6fbee000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788842073.219762:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788842073.219766:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875736500723456:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788842073.219771:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8d3a6fbe8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788842073.219790:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788842073.219793:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875736500723328:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788842073.220546:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788842073.220550:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788842073.220553:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d3a6fbe8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788842073.220558:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 391 00000100:00080000:0.0:1788842073.220564:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788842073.220570:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d3a6fbe8800 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:0.0:1788842073.220595:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3a76805880 x1875736500727040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788842073.220610:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788842073.220613:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788842073.220615:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d3a6fbee000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788842073.220618:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 391 00000100:00080000:0.0:1788842073.220620:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788842073.220633:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d3a6fbee000 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:0.0:1788842073.220646:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3a76804e00 x1875736500727168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788842073.221231:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76804a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6792fa91-218c-4171-b8ed-40bcd3d71b04:3308:1875736500726912:0@lo:400:kworker.0 00000100:00100000:1.0:1788842073.221267:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788842073.221278:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875736500727296:0@lo:400:kworker.0 00000100:00100000:3.0:1788842073.221432:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842073.221490:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500726912 00000100:00100000:0.0:1788842073.221498:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500726912 00000100:00100000:0.0:1788842073.221551:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788842073.221559:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:3308:x1875736500726912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788842073.221619:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:3308:x1875736500726912:12345-0@lo:400:kworker.0 Request processed in 60us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842073.221627:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788842073.221870:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842073.222132:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76804a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6792fa91-218c-4171-b8ed-40bcd3d71b04:3308:1875736500726912:0@lo:400:kworker.0 00000100:00100000:3.0:1788842073.222159:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875736500727040:0@lo:8:kworker.0 00000400:00000100:3.0:1788842073.222181:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875736500727040 offset 0 length 520: 4 00000100:00100000:3.0:1788842073.222198:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875736500727168:0@lo:8:kworker.0 00000400:00000100:3.0:1788842073.222233:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875736500727168 offset 0 length 520: 4 00000100:00100000:1.0:1788842073.222917:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500727296 00000100:00100000:1.0:1788842073.222925:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500727296 00000100:00100000:1.0:1788842073.222984:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788842073.222992:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a412aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875736500727296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788842073.223059:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a412aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875736500727296:12345-0@lo:400:kworker.0 Request processed in 68us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842073.223065:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788842073.223624:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d3a76807100 x1875736500727296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788842089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788842073.223638:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875736500727296:0@lo:400:kworker.0 00010000:00010000:3.0:1788842073.602215:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842074.628971:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842075.651019:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788842075.971648:0:14389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788842076.677168:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788842077.156116:0:15040:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788842077.156120:0:15040:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788842077.156236:0:15040:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d3a75de4000 00000020:01000004:0.0:1788842077.156252:0:15040:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788842077.156263:0:15040:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788842077.156277:0:15040:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d3a75f219b8) 00000020:00000080:0.0:1788842077.156293:0:15040:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788842077.196336:0:15040:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788842077.196577:0:15040:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788842077.199741:0:15040:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788842077.200061:0:15040:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788842077.200292:0:15040:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788842077.200939:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 483: rc = 0 00100000:10000000:3.0:1788842077.201042:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 483: rc = 0 00100000:10000000:3.0:1788842077.201131:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 483: rc = 0 00100000:10000000:3.0:1788842077.205124:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 640: rc = 0 00100000:10000000:3.0:1788842077.205448:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 640: rc = 0 00100000:10000000:3.0:1788842077.205993:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 640: rc = 0 00100000:10000000:3.0:1788842077.206226:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 640: rc = 0 00100000:10000000:3.0:1788842077.206618:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 640: rc = 0 00100000:10000000:3.0:1788842077.206910:0:15040:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 640: rc = 0 00000020:00000080:3.0:1788842077.209685:0:15040:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788842077.209699:0:15040:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788842077.209746:0:15040:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3de1064d33a8c206 00000020:01000004:3.0:1788842077.209757:0:15040:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788842077.209782:0:15040:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.155@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788842077.209786:0:15040:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788842077.209793:0:15040:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788842077.209797:0:15040:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788842077.209809:0:15040:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d3a75dd99b8) 00000020:00000080:3.0:1788842077.209819:0:15040:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788842077.213252:0:15040:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788842077.213540:0:15040:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788842077.213547:0:15040:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788842077.215168:0:15040:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788842077.215178:0:15040:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788842077.219857:0:15040:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788842077.219872:0:15040:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788842077.227685:0:15040:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788842077.228075:0:15040:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788842077.228081:0:15040:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788842077.230973:0:15040:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788842077.230992:0:15040:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788842077.246927:0:15040:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788842077.247196:0:15040:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788842077.247203:0:15040:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788842077.249324:0:15040:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788842077.249339:0:15040:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788842077.250661:0:15040:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788842077.250671:0:15040:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788842077.253212:0:15040:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788842077.253419:0:15040:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788842077.253425:0:15040:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788842077.254328:0:15040:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788842077.254337:0:15040:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788842077.294872:0:15040:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788842077.295129:0:15040:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788842077.295136:0:15040:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788842077.296388:0:15040:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788842077.296399:0:15040:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788842077.297051:0:15040:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788842077.297076:0:15040:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788842077.297088:0:15040:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.155@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788842077.306617:0:15040:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.155@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788842077.306669:0:15040:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.155@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788842077.306674:0:15040:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788842077.306675:0:15040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788842077.306677:0:15040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788842077.306678:0:15040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788842077.306679:0:15040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788842077.306680:0:15040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788842077.306682:0:15040:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788842077.306684:0:15040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788842077.306685:0:15040:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788842077.306689:0:15040:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788842077.306691:0:15040:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788842077.306693:0:15040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788842077.306694:0:15040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788842077.306695:0:15040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788842077.306696:0:15040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788842077.306697:0:15040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788842077.306698:0:15040:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788842077.306699:0:15040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788842077.306700:0:15040:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788842077.306806:0:15040:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788842077.306831:0:15040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76807100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500727424:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788842077.306904:0:15040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842077.307020:0:15040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a760360c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788842077.307071:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500727424 00000100:00100000:3.0:1788842077.307080:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500727424 00000100:00100000:3.0:1788842077.307166:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788842077.307177:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:15040:x1875736500727424:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788842077.307216:0:14352:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788842077.307220:0:14352:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788842077.307228:0:14352:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788842077.317519:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:15040:x1875736500727424:12345-0@lo:253:mount.lustre.0 Request processed in 10335us (10606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842077.317534:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788842077.317704:0:15040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76807100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500727424:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788842077.317747:0:15040:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788842077.317750:0:15040:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788842077.317752:0:15040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788842077.317754:0:15040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788842077.317755:0:15040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788842077.317756:0:15040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788842077.317757:0:15040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788842077.317759:0:15040:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788842077.317761:0:15040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788842077.317777:0:15040:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788842077.317800:0:15040:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d3a75de4000 from lustre-OST0000 10000000:01000000:0.0:1788842077.317837:0:15040:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788842077.317841:0:15040:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788842077.317847:0:15040:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d3a7c10b370 local copy 00010000:00010000:0.0:1788842077.317858:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8c0fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c103 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842077.318086:0:15040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76807100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500727552:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788842077.318124:0:15040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842077.318165:0:15040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a760366c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788842077.318660:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500727552 00000100:00100000:3.0:1788842077.318667:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500727552 00000100:00100000:3.0:1788842077.318738:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788842077.318747:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:15040:x1875736500727552:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788842077.318936:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:15040:x1875736500727552:12345-0@lo:501:mount.lustre.0 Request processed in 189us (811us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788842077.318945:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788842077.319034:0:15040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76807100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500727552:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788842077.319051:0:15040:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788842077.319208:0:15040:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788842077.319216:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8c0fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c103 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842077.319226:0:15040:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8c0fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c103 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788842077.319249:0:15040:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d3a75de4000 10000000:01000000:1.0:1788842077.319254:0:15040:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788842077.319259:0:15040:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d3a7c10b370 10000000:01000000:1.0:1788842077.319261:0:15040:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788842077.319265:0:15040:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d3a7c10b370 from 1 10000000:01000000:1.0:1788842077.319268:0:15040:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788842077.319295:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ee00/0x3de1064d33a8c214 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842077.319304:0:15040:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ee00/0x3de1064d33a8c214 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842077.319314:0:15040:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ee00/0x3de1064d33a8c214 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842077.319342:0:15040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500727680:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788842077.319373:0:15040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842077.319409:0:15040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7c5d7600 going to sleep for 11 seconds 00000100:00100000:3.0:1788842077.319652:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500727680 00000100:00100000:3.0:1788842077.319658:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500727680 00000100:00100000:3.0:1788842077.319696:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788842077.319704:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+12:15040:x1875736500727680:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788842077.319736:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842077.319751:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a60052400/0x3de1064d33a8c21b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8c214 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842077.319772:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a60052400/0x3de1064d33a8c21b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8c214 expref: 13 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842077.319782:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a60052400/0x3de1064d33a8c21b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c214 expref: 13 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842077.319792:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60052400, rc 0) 00000100:00100000:3.0:1788842077.319837:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+13:15040:x1875736500727680:12345-0@lo:101:mount.lustre.0 Request processed in 133us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842077.319852:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788842077.320336:0:15040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500727680:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788842077.320354:0:15040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ee00/0x3de1064d33a8c214 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c21b expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842077.320377:0:15040:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ee00/0x3de1064d33a8c214 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8c21b expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788842077.320396:0:15040:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788842077.320414:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ee00/0x3de1064d33a8c214 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c21b expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842077.320421:0:15040:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ee00/0x3de1064d33a8c214 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c21b expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788842077.320429:0:15040:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788842077.320434:0:15040:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788842077.320440:0:15040:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788842077.320443:0:15040:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788842077.320461:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cce00/0x3de1064d33a8c222 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842077.320468:0:15040:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cce00/0x3de1064d33a8c222 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842077.320476:0:15040:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cce00/0x3de1064d33a8c222 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842077.320490:0:15040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500727808:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788842077.320521:0:15040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842077.320607:0:15040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4518ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788842077.323163:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500727808 00000100:00100000:0.0:1788842077.323178:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500727808 00000100:00100000:1.0:1788842077.323294:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788842077.323305:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+13:15040:x1875736500727808:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788842077.323324:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788842077.323342:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c24f600/0x3de1064d33a8c229 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8c222 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842077.323368:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c24f600/0x3de1064d33a8c229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8c222 expref: 14 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842077.323378:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c24f600/0x3de1064d33a8c229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c222 expref: 14 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842077.323386:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c24f600, rc 0) 00000100:00100000:1.0:1788842077.323475:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+14:15040:x1875736500727808:12345-0@lo:101:mount.lustre.0 Request processed in 166us (2946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842077.323481:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788842077.323705:0:15040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500727808:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788842077.323752:0:15040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cce00/0x3de1064d33a8c222 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c229 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842077.323777:0:15040:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cce00/0x3de1064d33a8c222 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8c229 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788842077.324494:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788842077.325298:0:15040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788842077.325539:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788842077.325582:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788842077.325632:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788842077.325675:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788842077.325753:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788842077.325790:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788842077.325876:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788842077.325884:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788842077.325968:0:15040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500727936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788842077.326030:0:15040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842077.326086:0:15040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4518c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788842077.326723:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500727936 00000100:00100000:1.0:1788842077.326734:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500727936 00000100:00100000:1.0:1788842077.326793:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788842077.326803:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+14:15040:x1875736500727936:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788842077.327238:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+14:15040:x1875736500727936:12345-0@lo:501:mount.lustre.0 Request processed in 436us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842077.327247:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788842077.327829:0:15040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500727936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788842077.327886:0:15040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500728064:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788842077.327940:0:15040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842077.328024:0:15040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4518c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788842077.328769:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500728064 00000100:00100000:3.0:1788842077.328776:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500728064 00000100:00100000:3.0:1788842077.328823:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788842077.328832:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+14:15040:x1875736500728064:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788842077.331209:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+14:15040:x1875736500728064:12345-0@lo:503:mount.lustre.0 Request processed in 2368us (3258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842077.331223:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788842077.331334:0:15040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500728064:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788842077.332549:0:15040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788842077.332644:0:15040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500728192:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788842077.332733:0:15040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842077.332781:0:15040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3944e296c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788842077.332980:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500728192 00000100:00100000:1.0:1788842077.332988:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500728192 00000100:00100000:1.0:1788842077.333054:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788842077.333066:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+14:15040:x1875736500728192:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788842077.333349:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+14:15040:x1875736500728192:12345-0@lo:502:mount.lustre.0 Request processed in 284us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842077.333356:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788842077.334980:0:15040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500728192:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788842077.335340:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788842077.335406:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788842077.335441:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788842077.335502:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788842077.335542:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788842077.335572:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788842077.335646:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788842077.335683:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788842077.335757:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788842077.335803:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788842077.335837:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788842077.335885:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788842077.335966:0:15040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500728320:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788842077.336041:0:15040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842077.336092:0:15040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3944e296c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788842077.340158:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500728320 00000100:00100000:3.0:1788842077.340174:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500728320 00000100:00100000:3.0:1788842077.340255:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788842077.340266:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+14:15040:x1875736500728320:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788842077.342213:0:15040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500728320:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788842077.342722:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+14:15040:x1875736500728320:12345-0@lo:502:mount.lustre.0 Request processed in 1125us (5348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842077.342735:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000040:00080000:2.0:1788842077.343205:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788842077.343226:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1788842077.348504:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788842077.348516:0:15054:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788842077.348541:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788842077.348543:0:15054:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788842077.348551:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788842077.348567:0:15054:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d3a43568000) 00000020:00000080:2.0:1788842077.348606:0:15054:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788842077.348614:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788842077.348695:0:15054:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d3a75de4000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788842077.348703:0:15054:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788842077.348748:0:15054:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3de1064d33a8c237 00010000:00010000:2.0:1788842077.366119:0:15054:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1788842077.367401:0:15054:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1788842077.373110:0:15054:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788842077.380457:0:15054:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788842077.380470:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788842077.380477:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788842077.380479:0:15054:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788842077.380484:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788842077.380486:0:15054:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1788842077.380488:0:15054:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788842077.380489:0:15054:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788842077.380491:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788842077.380493:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788842077.380494:0:15054:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788842077.380496:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788842077.380499:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788842077.380500:0:15054:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788842077.380503:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788842077.380505:0:15054:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788842077.380507:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788842077.380509:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788842077.380510:0:15054:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788842077.380513:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788842077.380514:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788842077.380515:0:15054:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788842077.380519:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788842077.380606:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788842077.380610:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788842077.380612:0:15054:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788842077.380623:0:15054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788842077.382049:0:15040:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788842077.382090:0:15040:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788842077.382106:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cce00/0x3de1064d33a8c222 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c229 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842077.382117:0:15040:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cce00/0x3de1064d33a8c222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c229 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788842077.382125:0:15040:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3a75de4000 from 1 10000000:01000000:3.0:1788842077.382128:0:15040:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788842077.382161:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60053400/0x3de1064d33a8c23e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842077.382182:0:15040:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a60053400/0x3de1064d33a8c23e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842077.382193:0:15040:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a60053400/0x3de1064d33a8c23e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842077.382218:0:15040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500728448:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788842077.382283:0:15040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842077.382325:0:15040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a44f12c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788842077.382889:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500728448 00000100:00100000:1.0:1788842077.382897:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500728448 00000100:00100000:1.0:1788842077.382950:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788842077.382959:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+14:15040:x1875736500728448:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788842077.382971:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788842077.382984:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c24e200/0x3de1064d33a8c245 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8c23e expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842077.383009:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c24e200/0x3de1064d33a8c245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8c23e expref: 15 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842077.383018:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c24e200/0x3de1064d33a8c245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c23e expref: 15 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842077.383027:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c24e200, rc 0) 00000100:00100000:1.0:1788842077.383085:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+15:15040:x1875736500728448:12345-0@lo:101:mount.lustre.0 Request processed in 127us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842077.383092:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788842077.383193:0:15040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500728448:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788842077.383207:0:15040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a60053400/0x3de1064d33a8c23e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c245 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842077.383217:0:15040:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a60053400/0x3de1064d33a8c23e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8c245 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788842077.384199:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788842077.384822:0:15040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788842077.385068:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788842077.385111:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788842077.386400:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788842077.386418:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788842077.386518:0:15040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76804700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500728576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788842077.387701:0:15040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842077.388757:0:15040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a76036540 going to sleep for 11 seconds 00000100:00100000:1.0:1788842077.393647:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500728576 00000100:00100000:1.0:1788842077.393667:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500728576 00000100:00100000:1.0:1788842077.393742:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788842077.393752:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+15:15040:x1875736500728576:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788842077.394995:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+15:15040:x1875736500728576:12345-0@lo:501:mount.lustre.0 Request processed in 1238us (7292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842077.395005:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788842077.396901:0:15040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76804700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500728576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788842077.396970:0:15040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76804700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500728704:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788842077.397042:0:15040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842077.397134:0:15040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a76036540 going to sleep for 11 seconds 00000100:00100000:3.0:1788842077.397826:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500728704 00000100:00100000:3.0:1788842077.397835:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500728704 00000100:00100000:3.0:1788842077.397890:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788842077.397901:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+15:15040:x1875736500728704:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788842077.398147:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+15:15040:x1875736500728704:12345-0@lo:503:mount.lustre.0 Request processed in 248us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842077.398157:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788842077.398506:0:15040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76804700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500728704:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788842077.399328:0:15040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788842077.399410:0:15040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500728832:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788842077.399466:0:15040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842077.399510:0:15040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a49b28a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788842077.399680:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500728832 00000100:00100000:2.0:1788842077.399687:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500728832 00000100:00100000:2.0:1788842077.399741:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788842077.399752:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+15:15040:x1875736500728832:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788842077.399995:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+15:15040:x1875736500728832:12345-0@lo:502:mount.lustre.0 Request processed in 245us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842077.400004:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788842077.400144:0:15040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500728832:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788842077.400377:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788842077.400570:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788842077.400651:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788842077.400871:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788842077.400913:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788842077.400966:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788842077.401005:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788842077.401038:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788842077.401069:0:15040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500728960:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788842077.401121:0:15040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842077.401161:0:15040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a49b28a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788842077.401275:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500728960 00000100:00100000:3.0:1788842077.401281:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500728960 00000100:00100000:3.0:1788842077.401325:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788842077.401334:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+15:15040:x1875736500728960:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788842077.401506:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+15:15040:x1875736500728960:12345-0@lo:502:mount.lustre.0 Request processed in 173us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842077.401524:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788842077.401638:0:15040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500728960:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788842077.401765:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788842077.401777:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788842077.404054:0:15058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788842077.404066:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788842077.404069:0:15058:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788842077.404076:0:15058:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d3a75de4000 00000020:00000080:0.0:1788842077.404078:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788842077.404085:0:15058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788842077.404087:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788842077.404089:0:15058:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788842077.404091:0:15058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788842077.404093:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788842077.404095:0:15058:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788842077.404098:0:15058:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d3a75de4000 00000020:00000080:0.0:1788842077.404100:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788842077.404179:0:15058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788842077.404182:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788842077.404184:0:15058:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788842077.404187:0:15058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788842077.404189:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788842077.404191:0:15058:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788842077.404194:0:15058:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d3a75de4000 00000020:00000080:0.0:1788842077.404196:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788842077.404233:0:15058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788842077.404236:0:15058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788842077.404238:0:15058:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788842077.404241:0:15058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788842077.406158:0:15040:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788842077.406196:0:15040:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788842077.406219:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60053400/0x3de1064d33a8c23e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c245 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842077.406232:0:15040:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a60053400/0x3de1064d33a8c23e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c245 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788842077.406291:0:15040:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788842077.406295:0:15040:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d3a75de4000 10000000:01000000:1.0:1788842077.406298:0:15040:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d3a75de4000 10000000:01000000:1.0:1788842077.406302:0:15040:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788842077.406308:0:15040:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d3a75de4000 from 1 10000000:01000000:1.0:1788842077.406311:0:15040:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788842077.406357:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24fc00/0x3de1064d33a8c24c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842077.406365:0:15040:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24fc00/0x3de1064d33a8c24c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842077.406374:0:15040:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24fc00/0x3de1064d33a8c24c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842077.406398:0:15040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500729088:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788842077.406784:0:15040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842077.406828:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500729088 00000100:00100000:1.0:1788842077.406837:0:15040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a49b28600 going to sleep for 11 seconds 00000100:00100000:3.0:1788842077.406838:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500729088 00000100:00100000:3.0:1788842077.406889:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788842077.406899:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+15:15040:x1875736500729088:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788842077.406912:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842077.406926:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a60053600/0x3de1064d33a8c253 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8c24c expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842077.406954:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a60053600/0x3de1064d33a8c253 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8c24c expref: 16 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842077.406966:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a60053600/0x3de1064d33a8c253 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c24c expref: 16 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842077.406975:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60053600, rc 0) 00000100:00100000:3.0:1788842077.407018:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+16:15040:x1875736500729088:12345-0@lo:101:mount.lustre.0 Request processed in 120us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842077.407025:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788842077.407227:0:15040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500729088:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788842077.407245:0:15040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24fc00/0x3de1064d33a8c24c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c253 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842077.407255:0:15040:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24fc00/0x3de1064d33a8c24c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8c253 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788842077.408974:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788842077.410397:0:15040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788842077.412111:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788842077.412192:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788842077.412229:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788842077.412278:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788842077.412318:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788842077.412405:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788842077.412827:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788842077.412956:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788842077.413023:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788842077.413084:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788842077.413129:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788842077.413181:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788842077.413217:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788842077.413252:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788842077.413303:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788842077.413341:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788842077.413381:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788842077.416122:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788842077.416228:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788842077.416265:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788842077.416318:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788842077.416377:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788842077.416415:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788842077.416753:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788842077.416802:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788842077.416842:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788842077.417003:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788842077.417046:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788842077.417144:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788842077.417153:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788842077.417264:0:15040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500729216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788842077.417333:0:15040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842077.418233:0:15040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a49b28600 going to sleep for 11 seconds 00000100:00100000:2.0:1788842077.418290:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500729216 00000100:00100000:2.0:1788842077.418299:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500729216 00000100:00100000:2.0:1788842077.418352:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788842077.418361:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+16:15040:x1875736500729216:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788842077.422665:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+16:15040:x1875736500729216:12345-0@lo:501:mount.lustre.0 Request processed in 4292us (5319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842077.422691:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788842077.423023:0:15040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500729216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788842077.423088:0:15040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500729344:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788842077.423154:0:15040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842077.423979:0:15040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a49b28600 going to sleep for 11 seconds 00000100:00100000:0.0:1788842077.432804:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500729344 00000100:00100000:0.0:1788842077.432822:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500729344 00000100:00100000:0.0:1788842077.432928:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788842077.432939:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+16:15040:x1875736500729344:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788842077.433180:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+16:15040:x1875736500729344:12345-0@lo:503:mount.lustre.0 Request processed in 243us (10025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842077.433187:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788842077.433666:0:15040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500729344:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788842077.435434:0:15040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788842077.438112:0:15040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500729472:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788842077.438766:0:15040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842077.438816:0:15040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a49b28600 going to sleep for 11 seconds 00000100:00100000:2.0:1788842077.439558:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500729472 00000100:00100000:2.0:1788842077.439568:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500729472 00000100:00100000:2.0:1788842077.439644:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788842077.439656:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+16:15040:x1875736500729472:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788842077.439934:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+16:15040:x1875736500729472:12345-0@lo:502:mount.lustre.0 Request processed in 281us (1730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842077.439943:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788842077.440001:0:15040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500729472:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788842077.441401:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788842077.441790:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788842077.441826:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788842077.441942:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788842077.441978:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788842077.442039:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788842077.442070:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788842077.442096:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788842077.442134:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788842077.442161:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788842077.442188:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788842077.442224:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788842077.442257:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788842077.442288:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788842077.442332:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788842077.442375:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788842077.442647:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788842077.442817:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788842077.442851:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788842077.442952:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788842077.442995:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788842077.443045:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788842077.443076:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788842077.443138:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788842077.443173:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788842077.443209:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788842077.443248:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788842077.443277:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788842077.443304:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788842077.443340:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788842077.443368:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788842077.443395:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788842077.443435:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788842077.444147:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788842077.444195:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788842077.444241:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788842077.444278:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788842077.444335:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788842077.444413:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788842077.446612:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788842077.446675:0:15040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500729600:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788842077.446762:0:15040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842077.446815:0:15040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a49b28600 going to sleep for 11 seconds 00000100:00100000:2.0:1788842077.446825:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500729600 00000100:00100000:2.0:1788842077.446836:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500729600 00000100:00100000:2.0:1788842077.446891:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788842077.446903:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+16:15040:x1875736500729600:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788842077.447149:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+16:15040:x1875736500729600:12345-0@lo:502:mount.lustre.0 Request processed in 248us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842077.447181:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788842077.447314:0:15040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500729600:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788842077.447427:0:15040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788842077.447596:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788842077.451212:0:15063:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788842077.451228:0:15063:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d3a75f20000) 00000020:00000080:0.0:1788842077.451250:0:15063:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788842077.451337:0:15063:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d3a75de4000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788842077.451342:0:15063:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d3a75de4000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788842077.451346:0:15063:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d3a75de4000 3 00010000:00080000:0.0:1788842077.451378:0:15063:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d3a4f292000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.155@tcp at head 00010000:00010000:1.0:1788842077.454403:0:15063:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788842077.455324:0:15063:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788842077.455361:0:15063:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788842077.455374:0:15063:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x3de1064d33a8c261 00000100:00080000:1.0:1788842077.455383:0:15063:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788842077.455389:0:15063:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d3a4f292000 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:1.0:1788842077.455433:0:15063:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3a412a9c00 x1875736500729728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788842077.455475:0:15063:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788842077.456366:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788842077.456372:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788842077.456375:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788842077.456377:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788842077.456829:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875736500729728:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788842077.456982:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842077.457064:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500729728 00000100:00100000:0.0:1788842077.457072:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500729728 00000100:00100000:0.0:1788842077.457105:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788842077.457112:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875736500729728:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788842077.457139:0:14357:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 405 last 0 00000020:00000080:0.0:1788842077.457171:0:14357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3de1064d33a8c268 00000004:00100000:0.0:1788842077.457187:0:14357:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788842077.457218:0:14357:0:(import.c:65:import_set_state_nolock()) ffff8d3a4f295800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788842077.457265:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875736500729728:12345-0@lo:38:llog_process_th.0 Request processed in 152us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842077.457273:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788842077.457323:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d3a412a9c00 x1875736500729728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788842087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788842077.457334:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788842077.457341:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788842077.457348:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788842077.457352:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788842077.457354:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8d3a4f292000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788842077.457359:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875736500729728:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788842077.457474:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875736500729856:0@lo:400:kworker.0 00000100:00100000:1.0:1788842077.457501:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842077.459809:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500729856 00000100:00100000:0.0:1788842077.459824:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500729856 00000100:00100000:0.0:1788842077.460040:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788842077.460053:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a412a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875736500729856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788842077.460169:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a412a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875736500729856:12345-0@lo:400:kworker.0 Request processed in 119us (2665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842077.460177:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788842077.460235:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d3a49adce00 x1875736500729856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788842093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788842077.460251:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875736500729856:0@lo:400:kworker.0 00000040:00080000:1.0:1788842077.463546:0:15063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788842077.463691:0:15040:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788842077.463732:0:15040:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788842077.463752:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24fc00/0x3de1064d33a8c24c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c253 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842077.463765:0:15040:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24fc00/0x3de1064d33a8c24c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c253 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788842077.463813:0:15040:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788842077.463815:0:15040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788842077.463816:0:15040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788842077.463817:0:15040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788842077.463818:0:15040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788842077.463820:0:15040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788842077.463822:0:15040:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788842077.463823:0:15040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788842077.463825:0:15040:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788842077.463829:0:15040:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788842077.463831:0:15040:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788842077.463833:0:15040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788842077.463834:0:15040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788842077.463836:0:15040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788842077.463837:0:15040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788842077.463838:0:15040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788842077.463840:0:15040:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788842077.463841:0:15040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788842077.463842:0:15040:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788842077.463868:0:15040:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788842077.463888:0:15040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500729984:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788842077.463955:0:15040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842077.463991:0:15040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a49b280c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788842077.464049:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500729984 00000100:00100000:2.0:1788842077.464057:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500729984 00000100:00100000:2.0:1788842077.464102:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788842077.464111:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+16:15040:x1875736500729984:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788842077.464152:0:14351:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788842077.464166:0:14351:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788842077.496238:0:14351:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788842077.496252:0:14351:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788842077.498219:0:14374:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788842077.498229:0:14374:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788842077.498252:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d3a7c6cc000/0x3de1064d33a8c26f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842077.498271:0:14374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a7c24fe00/0x3de1064d33a8c1dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c1d5 expref: 16 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842077.498279:0:14374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d3a7c6cc000/0x3de1064d33a8c26f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842077.498321:0:14374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a7c24fe00/0x3de1064d33a8c1dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8c1d5 expref: 16 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842077.498337:0:14374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d3a7c24fe00/0x3de1064d33a8c1dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8c1d5 expref: 16 pid: 14351 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842077.498371:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14374:1875736500730112:0@lo:104: 00000100:00100000:2.0:1788842077.498437:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842077.498483:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a682b99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788842077.498765:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500730112 00000100:00100000:1.0:1788842077.498774:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500730112 00000100:00100000:1.0:1788842077.498816:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788842077.498828:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49adf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6792fa91-218c-4171-b8ed-40bcd3d71b04+3:14374:x1875736500730112:12345-0@lo:104: 00010000:00010000:1.0:1788842077.498840:0:14341:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24e400/0x3de1064d33a8c1d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8c1dc expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842077.499024:0:14341:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788842077.499031:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49adf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6792fa91-218c-4171-b8ed-40bcd3d71b04+3:14374:x1875736500730112:12345-0@lo:104: Request processed in 206us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842077.499040:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788842077.499117:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788842077.499125:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24e400/0x3de1064d33a8c1d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8c1dc expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842077.499133:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24e400 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:0.0:1788842077.499137:0:14346:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24e400/0x3de1064d33a8c1d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8c1dc expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842077.499154:0:14346:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24e400/0x3de1064d33a8c1d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8c1dc expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788842077.499161:0:14346:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24e400/0x3de1064d33a8c1d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8c1dc expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788842077.499167:0:14346:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788842077.499204:0:14346:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24e400/0x3de1064d33a8c1d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8c1dc expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842077.499212:0:14346:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788842077.499235:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24e400/0x3de1064d33a8c1d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8c1dc expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842077.499243:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24e400/0x3de1064d33a8c1d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8c1dc expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842077.499259:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842077.499261:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842077.499263:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788842077.499280:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76805180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6792fa91-218c-4171-b8ed-40bcd3d71b04:3307:1875736500730240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788842077.499315:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842077.499364:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500730240 00000100:00100000:0.0:1788842077.499368:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500730240 00000100:00100000:3.0:1788842077.499759:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14374:1875736500730112:0@lo:104: 00010000:00010000:3.0:1788842077.499783:0:14374:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d3a7c6cc000/0x3de1064d33a8c26f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842077.500390:0:14343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a7c24fe00/0x3de1064d33a8c1dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8c1d5 expref: 17 pid: 14351 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842077.500425:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788842077.500435:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76806300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6792fa91-218c-4171-b8ed-40bcd3d71b04+17:3307:x1875736500730240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788842077.500455:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788842077.500460:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a7c24fe00/0x3de1064d33a8c1dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8c1d5 expref: 17 pid: 14351 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842077.500471:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a7c24fe00/0x3de1064d33a8c1dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8c1d5 expref: 17 pid: 14351 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842077.500487:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a7c24fe00/0x3de1064d33a8c1dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8c1d5 expref: 17 pid: 14351 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842077.500500:0:14343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d3a7c6cc000/0x3de1064d33a8c26f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842077.500509:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c6cc000/0x3de1064d33a8c26f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788842077.500523:0:14343:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003208239s 00010000:00010000:0.0:1788842077.500527:0:14343:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3a7c6cc000/0x3de1064d33a8c26f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842077.500534:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3a7c6cc000/0x3de1064d33a8c26f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842077.500541:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d3a7c6cc000/0x3de1064d33a8c26f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842077.500548:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d3a7c6cc000/0x3de1064d33a8c26f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842077.500554:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cc000 already unused, calling callback (ffffffffc1813420) 00010000:00010000:0.0:1788842077.500558:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d3a7c6cc000/0x3de1064d33a8c26f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842077.500572:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d3a7c6cc000/0x3de1064d33a8c26f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842077.501321:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d3a7c6cc000/0x3de1064d33a8c26f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842077.501332:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788842077.501348:0:14374:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d3a7c6cc000/0x3de1064d33a8c26f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842077.501356:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d3a7c6cc000/0x3de1064d33a8c26f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842077.501362:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a7c6cc000/0x3de1064d33a8c26f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842077.501425:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76806300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6792fa91-218c-4171-b8ed-40bcd3d71b04+16:3307:x1875736500730240:12345-0@lo:103:ldlm_bl.0 Request processed in 991us (2108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842077.501433:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788842077.501471:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76805180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6792fa91-218c-4171-b8ed-40bcd3d71b04:3307:1875736500730240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788842077.507351:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+15:15040:x1875736500729984:12345-0@lo:253:mount.lustre.0 Request processed in 43232us (43386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842077.507368:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788842077.507467:0:15040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15040:1875736500729984:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788842077.507484:0:15040:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788842077.507488:0:15040:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788842077.507490:0:15040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788842077.507491:0:15040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788842077.507493:0:15040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788842077.507494:0:15040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788842077.507495:0:15040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788842077.507496:0:15040:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788842077.507498:0:15040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788842077.507511:0:15040:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788842077.507527:0:15040:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788842077.522696:0:15040:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788842077.523739:0:15040:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788842077.524040:0:15040:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788842077.524214:0:15040:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788842077.524361:0:15040:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788842077.524582:0:15040:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788842077.525835:0:15040:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788842077.618056:0:15040:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788842077.618068:0:15040:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788842077.618116:0:15040:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788842077.618176:0:15040:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.155@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788842077.618189:0:15040:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788842077.618220:0:15040:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788842077.698568:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842078.723228:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788842078.914844:0:14354:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788842078.914851:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d3a4fa2d800 from 7 10000000:01000000:1.0:1788842078.914857:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788842078.914903:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ea00/0x3de1064d33a8c276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842078.914915:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ea00/0x3de1064d33a8c276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842078.914926:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ea00/0x3de1064d33a8c276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842078.914952:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500730368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788842078.915035:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842078.915098:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a76036300 going to sleep for 11 seconds 00000100:00100000:0.0:1788842078.915214:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500730368 00000100:00100000:0.0:1788842078.915222:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500730368 00000100:00100000:0.0:1788842078.915281:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788842078.915290:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+15:14354:x1875736500730368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788842078.915304:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842078.915320:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c78ec00/0x3de1064d33a8c27d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8c276 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842078.915344:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c78ec00/0x3de1064d33a8c27d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8c276 expref: 16 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842078.915354:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c78ec00/0x3de1064d33a8c27d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c276 expref: 16 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842078.915363:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c78ec00, rc 0) 00000100:00100000:0.0:1788842078.915413:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+16:14354:x1875736500730368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842078.915419:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788842078.915607:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500730368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788842078.915624:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ea00/0x3de1064d33a8c276 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c27d expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842078.915633:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ea00/0x3de1064d33a8c276 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8c27d expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842078.915826:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500730496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788842078.915861:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842078.915893:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a76036300 going to sleep for 11 seconds 00000100:00100000:0.0:1788842078.915901:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500730496 00000100:00100000:0.0:1788842078.915906:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500730496 00000100:00100000:0.0:1788842078.915940:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788842078.915947:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+16:14354:x1875736500730496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788842078.915963:0:14351:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788842078.915981:0:14351:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788842078.915984:0:14351:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788842078.916075:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+16:14354:x1875736500730496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842078.916091:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788842078.916154:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500730496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788842078.916212:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788842078.916218:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ea00/0x3de1064d33a8c276 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c27d expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842078.916226:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ea00/0x3de1064d33a8c276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c27d expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842079.746887:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842080.770144:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842081.793870:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842082.818298:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788842082.949650:0:482:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788842082.949659:0:482:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788842082.949662:0:482:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788842082.949666:0:482:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788842082.949829:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788842082.949866:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6792fa91-218c-4171-b8ed-40bcd3d71b04:3307:1875736500730624:0@lo:400:kworker.0 00000100:00100000:0.0:1788842082.949985:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842082.950071:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875736500730880:0@lo:400:kworker.0 00000100:00100000:0.0:1788842082.950105:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842082.950290:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500730624 00000100:00100000:2.0:1788842082.950302:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500730624 00000100:00100000:2.0:1788842082.950681:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788842082.950693:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+16:3307:x1875736500730624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788842082.951026:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500730752:0@lo:400:kworker.0 00000100:00100000:0.0:1788842082.951877:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500730880 00000100:00100000:0.0:1788842082.951888:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500730880 00000100:00100000:0.0:1788842082.951945:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788842082.951954:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875736500730880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788842082.952023:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875736500730880:12345-0@lo:400:kworker.0 Request processed in 70us (1916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842082.952030:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788842082.952069:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788842082.952199:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a49adf100 x1875736500730880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788842098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788842082.952216:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875736500730880:0@lo:400:kworker.0 00000100:00100000:2.0:1788842082.952560:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+16:3307:x1875736500730624:12345-0@lo:400:kworker.0 Request processed in 1866us (2573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842082.952579:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788842082.952635:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6792fa91-218c-4171-b8ed-40bcd3d71b04:3307:1875736500730624:0@lo:400:kworker.0 00000100:00100000:3.0:1788842082.953048:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842082.953239:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500730752 00000100:00100000:2.0:1788842082.953246:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500730752 00000100:00100000:2.0:1788842082.953283:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788842082.953291:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500730752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788842082.953346:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500730752:12345-0@lo:400:kworker.0 Request processed in 55us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842082.953353:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788842082.953561:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a49add180 x1875736500730752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788842098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788842082.953591:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500730752:0@lo:400:kworker.0 00010000:00010000:2.0:1788842083.841852:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842084.869500:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788842085.156160:0:15407:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:0.0:1788842085.189174:0:14389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788842085.890752:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842086.915693:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842087.937807:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788842088.065888:0:482:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788842088.065894:0:482:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788842088.065897:0:482:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788842088.065900:0:482:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788842088.066844:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6792fa91-218c-4171-b8ed-40bcd3d71b04:3307:1875736500731008:0@lo:400:kworker.0 00000100:00100000:3.0:1788842088.066960:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842088.067042:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788842088.067050:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500731136:0@lo:400:kworker.0 00000100:00100000:3.0:1788842088.067110:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842088.067152:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500731264:0@lo:400:kworker.0 00000100:00100000:3.0:1788842088.067182:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842088.067238:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500731008 00000100:00100000:3.0:1788842088.067247:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500731008 00000100:00100000:3.0:1788842088.067302:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788842088.067313:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+16:3307:x1875736500731008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788842088.067379:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+16:3307:x1875736500731008:12345-0@lo:400:kworker.0 Request processed in 67us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842088.067398:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788842088.067436:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500731136 00000100:00100000:3.0:1788842088.067440:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500731136 00000100:00100000:3.0:1788842088.067467:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500731264 00000100:00100000:3.0:1788842088.067470:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500731264 00000100:00100000:3.0:1788842088.067496:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788842088.067503:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500731136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788842088.067535:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875736500731136:12345-0@lo:400:kworker.0 Request processed in 33us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842088.067857:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788842088.067871:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788842088.067878:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500731264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788842088.067912:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875736500731264:12345-0@lo:400:kworker.0 Request processed in 36us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842088.067918:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788842088.067970:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788842088.071651:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a49adfb80 x1875736500731264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788842104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788842088.071679:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875736500731264:0@lo:400:kworker.0 00010000:00080000:3.0:1788842088.074639:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a49ade300 x1875736500731136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788842104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788842088.074671:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875736500731136:0@lo:400:kworker.0 00000100:00100000:3.0:1788842088.074692:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6792fa91-218c-4171-b8ed-40bcd3d71b04:3307:1875736500731008:0@lo:400:kworker.0 00000100:00100000:2.0:1788842088.708223:0:3306:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788842073/real 1788842073] req@ffff8d3a76805880 x1875736500727040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788842088 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788842088.708267:0:3306:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d3a76805880 x1875736500727040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788842088 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788842088.708279:0:3306:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788842073/real 1788842073] req@ffff8d3a76804e00 x1875736500727168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788842088 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788842088.708292:0:3306:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d3a76804e00 x1875736500727168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788842088 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788842088.708335:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8d3a6fbe8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788842088.708414:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788842088.708419:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875736500727040:0@lo:8:kworker.0 00000100:00080000:2.0:1788842088.708427:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8d3a6fbee000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788842088.708459:0:482:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788842088.708475:0:482:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788842088.708480:0:482:0:(import.c:65:import_set_state_nolock()) ffff8d3a6fbe8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788842088.708485:0:482:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 401 00000100:00080000:1.0:1788842088.708492:0:482:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788842088.708500:0:482:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d3a6fbe8800 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:1.0:1788842088.708550:0:482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3a412a9f80 x1875736500731392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788842088.708565:0:482:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788842088.708569:0:482:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788842088.708571:0:482:0:(import.c:65:import_set_state_nolock()) ffff8d3a6fbee000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788842088.708574:0:482:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 401 00000100:00080000:1.0:1788842088.708582:0:482:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788842088.708586:0:482:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d3a6fbee000 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:1.0:1788842088.708600:0:482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3a412a8e00 x1875736500731520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788842088.708840:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788842088.708844:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875736500727168:0@lo:8:kworker.0 00000100:00100000:2.0:1788842088.708877:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875736500731392:0@lo:8:kworker.0 00000100:00100000:2.0:1788842088.708971:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842088.709027:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875736500731520:0@lo:8:kworker.0 00000100:00100000:2.0:1788842088.709050:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842088.709248:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500731392 00000100:00100000:1.0:1788842088.709258:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500731392 00000100:00100000:1.0:1788842088.709296:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500731520 00000100:00100000:1.0:1788842088.709298:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500731520 00000100:00100000:1.0:1788842088.709312:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788842088.709321:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1875736500731392:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788842088.709357:0:15042:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 416 last 0 00000020:00000080:1.0:1788842088.709403:0:15042:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3de1064d33a8c284 00002000:00100000:1.0:1788842088.709422:0:15042:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d3a76abc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113972 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788842088.709426:0:15042:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788842088.709429:0:15042:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788842088.710232:0:15042:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788842088.710266:0:15042:0:(import.c:65:import_set_state_nolock()) ffff8d3a76aba800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788842088.710406:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875736500731392:12345-0@lo:8:kworker.0 Request processed in 1084us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842088.710415:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788842088.710452:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788842088.710458:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1875736500731520:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788842088.710484:0:15042:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788842088.710511:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1875736500731520:12345-0@lo:8:kworker.0 Request processed in 53us (1460us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788842088.710517:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788842088.710688:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a412a9f80 x1875736500731392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788842108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788842088.710700:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788842088.710775:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788842088.710787:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788842088.710792:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788842088.710795:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8d3a6fbe8800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788842088.710842:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788842088.710848:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875736500731392:0@lo:8:kworker.0 00000100:00080000:2.0:1788842088.710863:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8d3a6fbee000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788842088.710867:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788842088.710870:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875736500731520:0@lo:8:kworker.0 00000100:00100000:2.0:1788842088.711043:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500731648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788842088.711098:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788842088.711207:0:14381:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1788842088.711230:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14381:1875736500731776:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788842088.711262:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842088.711279:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a76036480 going to sleep for 11 seconds 00000004:00080000:1.0:1788842088.711299:0:14380:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788842088.711772:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500731648 00000100:00100000:0.0:1788842088.711782:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500731648 00000004:00080000:1.0:1788842088.711790:0:14380:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 416869079938ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788842088.711856:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788842088.711867:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875736500731648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788842088.711904:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788842088.712170:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788842088.712790:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500731776 00000100:00100000:1.0:1788842088.712800:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500731776 00000100:00100000:1.0:1788842088.712838:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788842088.712845:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a412a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14381:x1875736500731776:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788842088.716127:0:15044:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788842088.716141:0:15044:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788842088.716148:0:15044:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00100000:0.0:1788842088.719143:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875736500731648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7196us (7961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842088.719162:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788842088.720844:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a412a8e00 x1875736500731648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788842104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788842088.720879:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500731648:0@lo:13:osp-pre-0-0.0 00002000:00010000:1.0:1788842088.738275:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842088.738288:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001699b75e/0x3de1064d33a8c28b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.738307:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1788842088.738311:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842088.738317:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001699b75e/0x3de1064d33a8c28b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.738346:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001699b75e/0x3de1064d33a8c28b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.738356:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001699b75e/0x3de1064d33a8c28b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.738364:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001699b75e/0x3de1064d33a8c28b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.738404:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788842088.738450:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788842088.738536:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001699b75e/0x3de1064d33a8c28b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842088.738550:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24f400 already unused, calling callback (ffffffffc1813420) 00010000:00010000:2.0:1788842088.738557:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001699b75e/0x3de1064d33a8c28b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842088.738571:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001699b75e/0x3de1064d33a8c28b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842088.738605:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001699b75e/0x3de1064d33a8c28b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842088.738615:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001699b75e/0x3de1064d33a8c28b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842088.738654:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842088.738657:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842088.738662:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788842088.743244:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842088.743258:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc3e264/0x3de1064d33a8c292 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.743276:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1788842088.743280:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842088.743286:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dc3e264/0x3de1064d33a8c292 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.743299:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dc3e264/0x3de1064d33a8c292 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.743309:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dc3e264/0x3de1064d33a8c292 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.743333:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dc3e264/0x3de1064d33a8c292 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.743381:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788842088.743419:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788842088.743434:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dc3e264/0x3de1064d33a8c292 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842088.743462:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24f800 already unused, calling callback (ffffffffc1813420) 00010000:00010000:2.0:1788842088.743468:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc3e264/0x3de1064d33a8c292 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842088.743480:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dc3e264/0x3de1064d33a8c292 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842088.743506:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dc3e264/0x3de1064d33a8c292 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842088.743515:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dc3e264/0x3de1064d33a8c292 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842088.743548:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842088.743553:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842088.743555:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788842088.744611:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842088.744621:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3127f8e/0x3de1064d33a8c299 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.744637:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1788842088.744640:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842088.744645:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3127f8e/0x3de1064d33a8c299 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.744656:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3127f8e/0x3de1064d33a8c299 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.744664:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3127f8e/0x3de1064d33a8c299 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.744670:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3127f8e/0x3de1064d33a8c299 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.744693:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788842088.746294:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788842088.746314:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3127f8e/0x3de1064d33a8c299 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842088.746331:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24e000 already unused, calling callback (ffffffffc1813420) 00010000:00010000:2.0:1788842088.746337:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3127f8e/0x3de1064d33a8c299 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842088.746350:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3127f8e/0x3de1064d33a8c299 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788842088.746502:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842088.746514:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca26e369/0x3de1064d33a8c2a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.746536:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1788842088.746545:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842088.746555:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca26e369/0x3de1064d33a8c2a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842088.746575:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3127f8e/0x3de1064d33a8c299 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.746576:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca26e369/0x3de1064d33a8c2a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842088.746620:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3127f8e/0x3de1064d33a8c299 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.746623:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca26e369/0x3de1064d33a8c2a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.746664:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca26e369/0x3de1064d33a8c2a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842088.746687:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788842088.746697:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788842088.746702:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca26e369/0x3de1064d33a8c2a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842088.746748:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24e400 already unused, calling callback (ffffffffc1813420) 00010000:00010000:2.0:1788842088.746752:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca26e369/0x3de1064d33a8c2a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842088.746763:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca26e369/0x3de1064d33a8c2a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842088.746778:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca26e369/0x3de1064d33a8c2a0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842088.746785:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca26e369/0x3de1064d33a8c2a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842088.746803:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842088.746806:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842088.746821:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842088.746883:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788842088.747597:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842088.747606:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4e48e5f/0x3de1064d33a8c2a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.747619:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1788842088.747622:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842088.747627:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4e48e5f/0x3de1064d33a8c2a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.747639:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4e48e5f/0x3de1064d33a8c2a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.747661:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4e48e5f/0x3de1064d33a8c2a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.747668:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4e48e5f/0x3de1064d33a8c2a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.747689:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788842088.748143:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788842088.748154:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4e48e5f/0x3de1064d33a8c2a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842088.748165:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24fe00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:2.0:1788842088.748170:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4e48e5f/0x3de1064d33a8c2a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842088.748180:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4e48e5f/0x3de1064d33a8c2a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842088.748201:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4e48e5f/0x3de1064d33a8c2a7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842088.748208:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4e48e5f/0x3de1064d33a8c2a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842088.748230:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842088.748232:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842088.748233:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788842088.750451:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842088.750466:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3364636/0x3de1064d33a8c2ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.750484:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1788842088.750489:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842088.750495:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3364636/0x3de1064d33a8c2ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.750510:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3364636/0x3de1064d33a8c2ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.750520:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3364636/0x3de1064d33a8c2ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.750527:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3364636/0x3de1064d33a8c2ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.750577:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788842088.751266:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788842088.751281:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3364636/0x3de1064d33a8c2ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.751295:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24f000 already unused, calling callback (ffffffffc1813420) 00010000:00010000:0.0:1788842088.751301:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3364636/0x3de1064d33a8c2ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.751312:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3364636/0x3de1064d33a8c2ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.751341:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3364636/0x3de1064d33a8c2ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.751362:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3364636/0x3de1064d33a8c2ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.751403:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842088.751405:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842088.751407:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788842088.752647:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842088.752662:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e73b1fab/0x3de1064d33a8c2b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.752679:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1788842088.752684:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842088.752691:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e73b1fab/0x3de1064d33a8c2b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.752705:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e73b1fab/0x3de1064d33a8c2b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.752744:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e73b1fab/0x3de1064d33a8c2b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.752751:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e73b1fab/0x3de1064d33a8c2b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.752782:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788842088.752822:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788842088.752835:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e73b1fab/0x3de1064d33a8c2b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.752847:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24e800 already unused, calling callback (ffffffffc1813420) 00010000:00010000:0.0:1788842088.752866:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e73b1fab/0x3de1064d33a8c2b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.752877:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e73b1fab/0x3de1064d33a8c2b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.752903:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e73b1fab/0x3de1064d33a8c2b5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.752911:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e73b1fab/0x3de1064d33a8c2b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.752944:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842088.752946:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842088.752948:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788842088.754815:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842088.754828:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000675e0eb3/0x3de1064d33a8c2bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.754846:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1788842088.754859:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842088.754866:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000675e0eb3/0x3de1064d33a8c2bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.754881:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000675e0eb3/0x3de1064d33a8c2bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.754891:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000675e0eb3/0x3de1064d33a8c2bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.754899:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000675e0eb3/0x3de1064d33a8c2bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.754926:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788842088.754973:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788842088.754988:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000675e0eb3/0x3de1064d33a8c2bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.755001:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24ec00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:0.0:1788842088.755007:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000675e0eb3/0x3de1064d33a8c2bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.755019:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000675e0eb3/0x3de1064d33a8c2bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.755043:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000675e0eb3/0x3de1064d33a8c2bc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.755063:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000675e0eb3/0x3de1064d33a8c2bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.755092:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842088.755094:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842088.755096:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788842088.756999:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842088.757010:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3323817/0x3de1064d33a8c2c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.757026:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1788842088.757031:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842088.757036:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3323817/0x3de1064d33a8c2c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.757049:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3323817/0x3de1064d33a8c2c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.757057:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3323817/0x3de1064d33a8c2c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.757071:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3323817/0x3de1064d33a8c2c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.757419:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788842088.757810:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788842088.757825:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3323817/0x3de1064d33a8c2c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.757840:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24e600 already unused, calling callback (ffffffffc1813420) 00010000:00010000:0.0:1788842088.757846:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3323817/0x3de1064d33a8c2c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.757858:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3323817/0x3de1064d33a8c2c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.757889:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3323817/0x3de1064d33a8c2c3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.757899:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3323817/0x3de1064d33a8c2c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.757940:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842088.757943:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842088.757948:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788842088.758944:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842088.758956:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa5313e2/0x3de1064d33a8c2ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.758974:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1788842088.758979:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842088.758985:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa5313e2/0x3de1064d33a8c2ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.759001:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa5313e2/0x3de1064d33a8c2ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.759012:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa5313e2/0x3de1064d33a8c2ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.759020:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa5313e2/0x3de1064d33a8c2ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.759051:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788842088.759079:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788842088.759090:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa5313e2/0x3de1064d33a8c2ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842088.759101:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24f200 already unused, calling callback (ffffffffc1813420) 00010000:00010000:3.0:1788842088.759105:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa5313e2/0x3de1064d33a8c2ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842088.759133:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa5313e2/0x3de1064d33a8c2ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842088.759156:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa5313e2/0x3de1064d33a8c2ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842088.759165:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa5313e2/0x3de1064d33a8c2ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842088.759191:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842088.759193:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842088.759194:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788842088.764442:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788842088.764459:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027d70e8a/0x3de1064d33a8c2d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.764482:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788842088.764489:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842088.764497:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027d70e8a/0x3de1064d33a8c2d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.764514:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027d70e8a/0x3de1064d33a8c2d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.764526:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027d70e8a/0x3de1064d33a8c2d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.764534:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027d70e8a/0x3de1064d33a8c2d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.764561:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788842088.764599:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788842088.764617:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027d70e8a/0x3de1064d33a8c2d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.764650:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78fa00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842088.764656:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027d70e8a/0x3de1064d33a8c2d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.764668:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027d70e8a/0x3de1064d33a8c2d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.764694:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027d70e8a/0x3de1064d33a8c2d1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.764703:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027d70e8a/0x3de1064d33a8c2d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.764822:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842088.764828:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842088.764835:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788842088.765094:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788842088.765102:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a52f08fb/0x3de1064d33a8c2d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.765113:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788842088.765116:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842088.765121:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a52f08fb/0x3de1064d33a8c2d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.765145:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a52f08fb/0x3de1064d33a8c2d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.765154:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a52f08fb/0x3de1064d33a8c2d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.765161:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a52f08fb/0x3de1064d33a8c2d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.765183:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788842088.765386:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788842088.765395:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a52f08fb/0x3de1064d33a8c2d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.765406:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78e400 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842088.765410:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a52f08fb/0x3de1064d33a8c2d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.765420:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a52f08fb/0x3de1064d33a8c2d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.765444:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a52f08fb/0x3de1064d33a8c2d8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.765452:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a52f08fb/0x3de1064d33a8c2d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.765475:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842088.765477:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842088.765483:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788842088.765634:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788842088.765641:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edd0f0ae/0x3de1064d33a8c2df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.765651:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788842088.765654:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842088.765658:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edd0f0ae/0x3de1064d33a8c2df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.765666:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edd0f0ae/0x3de1064d33a8c2df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.765673:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edd0f0ae/0x3de1064d33a8c2df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.765690:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edd0f0ae/0x3de1064d33a8c2df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.765732:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788842088.765781:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1788842088.766151:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788842088.766158:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a89d0f63/0x3de1064d33a8c2e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.766168:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788842088.766171:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842088.766176:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a89d0f63/0x3de1064d33a8c2e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.766185:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a89d0f63/0x3de1064d33a8c2e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.766194:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a89d0f63/0x3de1064d33a8c2e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.766202:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a89d0f63/0x3de1064d33a8c2e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.766221:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788842088.766452:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edd0f0ae/0x3de1064d33a8c2df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.766463:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f000 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842088.766468:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edd0f0ae/0x3de1064d33a8c2df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.766476:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edd0f0ae/0x3de1064d33a8c2df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.766491:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edd0f0ae/0x3de1064d33a8c2df lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.766497:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edd0f0ae/0x3de1064d33a8c2df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.766534:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788842088.766538:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a89d0f63/0x3de1064d33a8c2e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.766544:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f200 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842088.766548:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a89d0f63/0x3de1064d33a8c2e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.766556:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a89d0f63/0x3de1064d33a8c2e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.766566:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a89d0f63/0x3de1064d33a8c2e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.766573:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a89d0f63/0x3de1064d33a8c2e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.766586:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842088.766587:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842088.766589:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842088.766598:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788842088.767502:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788842088.767514:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000921ef9b5/0x3de1064d33a8c2ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.767537:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788842088.767541:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842088.767548:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000921ef9b5/0x3de1064d33a8c2ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.767561:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000921ef9b5/0x3de1064d33a8c2ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.767570:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000921ef9b5/0x3de1064d33a8c2ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.767579:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000921ef9b5/0x3de1064d33a8c2ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.767603:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788842088.768059:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788842088.768065:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fc2c35e/0x3de1064d33a8c2f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.768074:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788842088.768077:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842088.768081:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fc2c35e/0x3de1064d33a8c2f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.768091:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fc2c35e/0x3de1064d33a8c2f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.768110:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fc2c35e/0x3de1064d33a8c2f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.768117:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fc2c35e/0x3de1064d33a8c2f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.768131:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788842088.768498:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788842088.768504:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f3b211d/0x3de1064d33a8c2fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.768514:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788842088.768517:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842088.768521:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f3b211d/0x3de1064d33a8c2fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.768531:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f3b211d/0x3de1064d33a8c2fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.768539:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f3b211d/0x3de1064d33a8c2fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.768547:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f3b211d/0x3de1064d33a8c2fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.768565:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788842088.768947:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788842088.768953:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a20f6cfb/0x3de1064d33a8c302 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.768961:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788842088.768964:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842088.768970:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a20f6cfb/0x3de1064d33a8c302 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.768978:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a20f6cfb/0x3de1064d33a8c302 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.768985:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a20f6cfb/0x3de1064d33a8c302 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.768992:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a20f6cfb/0x3de1064d33a8c302 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.769000:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788842088.769586:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788842088.769593:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082513d80/0x3de1064d33a8c309 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.769604:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788842088.769614:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842088.769619:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082513d80/0x3de1064d33a8c309 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.769630:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082513d80/0x3de1064d33a8c309 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.769639:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082513d80/0x3de1064d33a8c309 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.769645:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082513d80/0x3de1064d33a8c309 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.769653:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1788842088.770547:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788842088.770563:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000921ef9b5/0x3de1064d33a8c2ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.770577:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78ea00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842088.770595:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000921ef9b5/0x3de1064d33a8c2ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.770609:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000921ef9b5/0x3de1064d33a8c2ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.770634:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000921ef9b5/0x3de1064d33a8c2ed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.770653:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000921ef9b5/0x3de1064d33a8c2ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.770682:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788842088.770686:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fc2c35e/0x3de1064d33a8c2f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.770693:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f800 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842088.770696:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fc2c35e/0x3de1064d33a8c2f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.770704:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fc2c35e/0x3de1064d33a8c2f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.770734:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fc2c35e/0x3de1064d33a8c2f4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.770740:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fc2c35e/0x3de1064d33a8c2f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.770760:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788842088.770763:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f3b211d/0x3de1064d33a8c2fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.770769:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78f600 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842088.770772:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f3b211d/0x3de1064d33a8c2fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.770779:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f3b211d/0x3de1064d33a8c2fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.770788:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f3b211d/0x3de1064d33a8c2fb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.770795:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f3b211d/0x3de1064d33a8c2fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.770805:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788842088.770808:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a20f6cfb/0x3de1064d33a8c302 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.770815:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78e000 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842088.770818:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a20f6cfb/0x3de1064d33a8c302 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.770835:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a20f6cfb/0x3de1064d33a8c302 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.770845:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a20f6cfb/0x3de1064d33a8c302 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.770852:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a20f6cfb/0x3de1064d33a8c302 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.770865:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788842088.770869:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082513d80/0x3de1064d33a8c309 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.770876:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78e800 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842088.770879:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082513d80/0x3de1064d33a8c309 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.770887:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082513d80/0x3de1064d33a8c309 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.770896:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082513d80/0x3de1064d33a8c309 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.770904:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082513d80/0x3de1064d33a8c309 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.770930:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842088.770933:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842088.770935:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842088.770946:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788842088.771769:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788842088.771781:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004965dfb/0x3de1064d33a8c310 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.771798:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788842088.771802:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842088.771809:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004965dfb/0x3de1064d33a8c310 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.771823:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004965dfb/0x3de1064d33a8c310 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.771832:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004965dfb/0x3de1064d33a8c310 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.771846:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004965dfb/0x3de1064d33a8c310 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.771863:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788842088.772425:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788842088.772432:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e103d88/0x3de1064d33a8c317 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.772443:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788842088.772446:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842088.772451:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e103d88/0x3de1064d33a8c317 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.772461:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e103d88/0x3de1064d33a8c317 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.772470:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e103d88/0x3de1064d33a8c317 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.772478:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e103d88/0x3de1064d33a8c317 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.772493:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788842088.772970:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788842088.772978:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086284f71/0x3de1064d33a8c31e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.772993:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788842088.772997:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842088.773002:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086284f71/0x3de1064d33a8c31e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.773012:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086284f71/0x3de1064d33a8c31e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.773020:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086284f71/0x3de1064d33a8c31e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.773027:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086284f71/0x3de1064d33a8c31e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.773036:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788842088.773451:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788842088.773457:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036abd360/0x3de1064d33a8c325 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.773466:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788842088.773469:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842088.773474:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036abd360/0x3de1064d33a8c325 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.773484:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036abd360/0x3de1064d33a8c325 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.773504:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036abd360/0x3de1064d33a8c325 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.773512:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036abd360/0x3de1064d33a8c325 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.773521:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788842088.773977:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788842088.773985:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b28d8ae5/0x3de1064d33a8c32c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.773997:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788842088.774001:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842088.774006:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b28d8ae5/0x3de1064d33a8c32c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.774016:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b28d8ae5/0x3de1064d33a8c32c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.774023:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b28d8ae5/0x3de1064d33a8c32c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.774030:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b28d8ae5/0x3de1064d33a8c32c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.774050:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1788842088.774438:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788842088.774449:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004965dfb/0x3de1064d33a8c310 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.774460:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78e600 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842088.774465:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004965dfb/0x3de1064d33a8c310 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.774477:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004965dfb/0x3de1064d33a8c310 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.774498:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004965dfb/0x3de1064d33a8c310 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.774505:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004965dfb/0x3de1064d33a8c310 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.774528:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788842088.774533:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e103d88/0x3de1064d33a8c317 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.774543:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78ee00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842088.774554:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e103d88/0x3de1064d33a8c317 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.774562:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e103d88/0x3de1064d33a8c317 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.774573:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e103d88/0x3de1064d33a8c317 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.774579:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e103d88/0x3de1064d33a8c317 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.774592:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788842088.774596:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086284f71/0x3de1064d33a8c31e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.774603:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a77601c00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842088.774607:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086284f71/0x3de1064d33a8c31e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.774614:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086284f71/0x3de1064d33a8c31e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.774625:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086284f71/0x3de1064d33a8c31e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.774632:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086284f71/0x3de1064d33a8c31e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.774665:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788842088.774669:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036abd360/0x3de1064d33a8c325 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.774676:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a77601200 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842088.774678:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036abd360/0x3de1064d33a8c325 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.774686:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036abd360/0x3de1064d33a8c325 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.774697:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036abd360/0x3de1064d33a8c325 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.774703:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036abd360/0x3de1064d33a8c325 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.774751:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788842088.774754:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b28d8ae5/0x3de1064d33a8c32c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.774761:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a77600600 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842088.774764:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b28d8ae5/0x3de1064d33a8c32c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.774782:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b28d8ae5/0x3de1064d33a8c32c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.774792:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b28d8ae5/0x3de1064d33a8c32c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.774799:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b28d8ae5/0x3de1064d33a8c32c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.774812:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842088.774814:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842088.774816:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842088.774826:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788842088.775440:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788842088.775449:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017fa5640/0x3de1064d33a8c333 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.775464:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788842088.775468:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842088.775474:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017fa5640/0x3de1064d33a8c333 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.775486:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017fa5640/0x3de1064d33a8c333 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.775496:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017fa5640/0x3de1064d33a8c333 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.775504:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017fa5640/0x3de1064d33a8c333 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.775526:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788842088.776051:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788842088.776057:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7ffd96b/0x3de1064d33a8c33a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.776068:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788842088.776144:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842088.776170:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7ffd96b/0x3de1064d33a8c33a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.776200:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7ffd96b/0x3de1064d33a8c33a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.776211:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7ffd96b/0x3de1064d33a8c33a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.776219:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7ffd96b/0x3de1064d33a8c33a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.776246:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788842088.777355:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788842088.777378:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017fa5640/0x3de1064d33a8c333 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.777400:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a77600a00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842088.777405:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017fa5640/0x3de1064d33a8c333 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.777417:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017fa5640/0x3de1064d33a8c333 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.777443:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017fa5640/0x3de1064d33a8c333 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.777469:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017fa5640/0x3de1064d33a8c333 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.777499:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788842088.777503:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7ffd96b/0x3de1064d33a8c33a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.777510:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a77600400 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842088.777513:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7ffd96b/0x3de1064d33a8c33a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.777521:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7ffd96b/0x3de1064d33a8c33a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.777535:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7ffd96b/0x3de1064d33a8c33a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.777542:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7ffd96b/0x3de1064d33a8c33a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.777555:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842088.777556:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842088.777558:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842088.777568:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788842088.777774:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788842088.777784:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060ff6db2/0x3de1064d33a8c341 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.777799:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1788842088.777802:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842088.777877:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060ff6db2/0x3de1064d33a8c341 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.777893:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060ff6db2/0x3de1064d33a8c341 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.777902:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060ff6db2/0x3de1064d33a8c341 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.777916:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060ff6db2/0x3de1064d33a8c341 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842088.777935:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788842088.778106:0:15044:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:0.0:1788842088.778192:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a412a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14381:x1875736500731776:12345-0@lo:5:osp-pre-0-0.0 Request processed in 65344us (66926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842088.778207:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788842088.778935:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14381:1875736500731776:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788842088.778977:0:14381:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1788842088.779046:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14381:1875736500731904:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788842088.779114:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842088.779173:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500731904 00000100:00100000:1.0:1788842088.779179:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a76036480 going to sleep for 11 seconds 00000100:00100000:0.0:1788842088.779185:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500731904 00010000:00010000:1.0:1788842088.779202:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788842088.779212:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060ff6db2/0x3de1064d33a8c341 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.779225:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a77601600 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842088.779230:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060ff6db2/0x3de1064d33a8c341 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842088.779250:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788842088.779264:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060ff6db2/0x3de1064d33a8c341 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842088.779265:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a412a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14381:x1875736500731904:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1788842088.779302:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060ff6db2/0x3de1064d33a8c341 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842088.779312:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060ff6db2/0x3de1064d33a8c341 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788842088.779317:0:15042:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:1.0:1788842088.779340:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842088.779344:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842088.779348:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788842088.782949:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788842088.792495:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a412a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14381:x1875736500731904:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13225us (13374us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788842088.792510:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788842088.792653:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14381:1875736500731904:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788842088.792671:0:14381:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1788842088.962806:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842089.990024:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842091.010939:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842092.034328:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842093.058935:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788842093.172050:0:15758:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788842093.172055:0:15758:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788842093.172204:0:15758:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d3a76a92800 00000020:01000004:2.0:1788842093.172223:0:15758:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788842093.172238:0:15758:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788842093.172268:0:15758:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d3945db19b8) 00000020:00000080:2.0:1788842093.172305:0:15758:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788842093.206933:0:15758:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788842093.209451:0:15758:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788842093.210464:0:15758:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788842093.211266:0:15758:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788842093.211511:0:15758:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788842093.211921:0:15758:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 191: rc = 0 00100000:10000000:2.0:1788842093.212015:0:15758:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 191: rc = 0 00100000:10000000:2.0:1788842093.212326:0:15758:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 191: rc = 0 00100000:10000000:2.0:1788842093.215936:0:15758:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:2.0:1788842093.218735:0:15758:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 641: rc = 0 00100000:10000000:2.0:1788842093.219024:0:15758:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 641: rc = 0 00100000:10000000:2.0:1788842093.219269:0:15758:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 641: rc = 0 00100000:10000000:2.0:1788842093.220478:0:15758:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 641: rc = 0 00100000:10000000:2.0:1788842093.220778:0:15758:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 641: rc = 0 00000020:00000080:2.0:1788842093.221515:0:15758:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788842093.221528:0:15758:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788842093.221538:0:15758:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3de1064d33a8c34f 00000020:01000004:2.0:1788842093.221546:0:15758:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788842093.221626:0:15758:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.155@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788842093.221630:0:15758:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788842093.221636:0:15758:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788842093.221658:0:15758:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788842093.221662:0:15758:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.155@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788842093.244254:0:15758:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.155@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788842093.244312:0:15758:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.155@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788842093.244318:0:15758:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788842093.244324:0:15758:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788842093.244326:0:15758:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788842093.244327:0:15758:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788842093.244329:0:15758:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788842093.244330:0:15758:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788842093.244332:0:15758:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788842093.244334:0:15758:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788842093.244336:0:15758:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788842093.244340:0:15758:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788842093.244342:0:15758:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788842093.244343:0:15758:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788842093.244344:0:15758:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788842093.244345:0:15758:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788842093.244346:0:15758:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788842093.244347:0:15758:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788842093.244349:0:15758:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788842093.244350:0:15758:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788842093.244351:0:15758:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788842093.244391:0:15758:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788842093.244413:0:15758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49ade680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500732032:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788842093.244495:0:15758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842093.244548:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500732032 00000100:00100000:2.0:1788842093.247481:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500732032 00000100:00100000:2.0:1788842093.248048:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788842093.248062:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+16:15758:x1875736500732032:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788842093.248103:0:14350:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788842093.248107:0:14350:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788842093.248112:0:14350:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788842093.248195:0:15758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a433bf600 going to sleep for 11 seconds 00000100:00100000:2.0:1788842093.272224:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+16:15758:x1875736500732032:12345-0@lo:253:mount.lustre.0 Request processed in 24156us (27719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842093.272239:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788842093.272522:0:15758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49ade680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500732032:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788842093.272542:0:15758:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788842093.272626:0:15758:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788842093.272630:0:15758:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788842093.272631:0:15758:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788842093.272633:0:15758:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788842093.272634:0:15758:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788842093.272635:0:15758:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788842093.272637:0:15758:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788842093.272639:0:15758:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788842093.272640:0:15758:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788842093.272663:0:15758:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d3a76a92800 from lustre-OST0001 10000000:01000000:2.0:1788842093.272691:0:15758:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788842093.272694:0:15758:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788842093.272703:0:15758:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d3a7c10b370 local copy 00010000:00010000:2.0:1788842093.273407:0:15758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8c0fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c103 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842093.273695:0:15758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49ade680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500732160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788842093.273782:0:15758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842093.273820:0:15758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a433bf3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788842093.274751:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500732160 00000100:00100000:1.0:1788842093.274761:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500732160 00000100:00100000:1.0:1788842093.274825:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788842093.274838:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+16:15758:x1875736500732160:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788842093.276170:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+16:15758:x1875736500732160:12345-0@lo:501:mount.lustre.0 Request processed in 1330us (2383us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788842093.276183:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788842093.277896:0:15758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49ade680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500732160:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788842093.277925:0:15758:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788842093.278154:0:15758:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788842093.278164:0:15758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8c0fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c103 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842093.278175:0:15758:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a60053a00/0x3de1064d33a8c0fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c103 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788842093.278215:0:15758:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d3a76a92800 10000000:01000000:3.0:1788842093.278221:0:15758:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788842093.278228:0:15758:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788842093.278238:0:15758:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788842093.278243:0:15758:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788842093.278246:0:15758:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788842093.278294:0:15758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60052e00/0x3de1064d33a8c356 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842093.278303:0:15758:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a60052e00/0x3de1064d33a8c356 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842093.278314:0:15758:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a60052e00/0x3de1064d33a8c356 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842093.278348:0:15758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500732288:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788842093.278415:0:15758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842093.278465:0:15758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4ea5af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788842093.278603:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500732288 00000100:00100000:1.0:1788842093.278609:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500732288 00000100:00100000:1.0:1788842093.278655:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788842093.278664:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+16:15758:x1875736500732288:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788842093.278678:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788842093.278691:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c24f000/0x3de1064d33a8c35d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8c356 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842093.278735:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c24f000/0x3de1064d33a8c35d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8c356 expref: 17 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842093.278746:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c24f000/0x3de1064d33a8c35d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c356 expref: 17 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842093.278754:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c24f000, rc 0) 00000100:00100000:1.0:1788842093.278789:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+17:15758:x1875736500732288:12345-0@lo:101:mount.lustre.0 Request processed in 126us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842093.278795:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788842093.278834:0:15758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500732288:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788842093.278854:0:15758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a60052e00/0x3de1064d33a8c356 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c35d expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842093.278862:0:15758:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a60052e00/0x3de1064d33a8c356 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8c35d expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788842093.279503:0:15758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788842093.280359:0:15758:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788842093.280597:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788842093.280642:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788842093.280678:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788842093.280790:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788842093.280829:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788842093.280869:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788842093.280940:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788842093.280949:0:15758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788842093.281043:0:15758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500732416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788842093.281108:0:15758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842093.281145:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500732416 00000100:00100000:1.0:1788842093.281151:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500732416 00000100:00100000:1.0:1788842093.281189:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788842093.281198:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7d87c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+17:15758:x1875736500732416:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788842093.283454:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7d87c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+17:15758:x1875736500732416:12345-0@lo:501:mount.lustre.0 Request processed in 2249us (2339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842093.283467:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788842093.283535:0:15758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7607b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788842093.283787:0:15758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500732416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788842093.283843:0:15758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500732544:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788842093.283898:0:15758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842093.284311:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500732544 00000100:00100000:3.0:1788842093.284318:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500732544 00000100:00100000:3.0:1788842093.284362:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788842093.284371:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7d87e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+17:15758:x1875736500732544:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788842093.284688:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7d87e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+17:15758:x1875736500732544:12345-0@lo:503:mount.lustre.0 Request processed in 318us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842093.284697:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788842093.285332:0:15758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7607b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788842093.285356:0:15758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500732544:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788842093.288679:0:15758:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788842093.288822:0:15758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500732672:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788842093.288911:0:15758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842093.289377:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500732672 00000100:00100000:0.0:1788842093.289386:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500732672 00000100:00100000:0.0:1788842093.289427:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788842093.289436:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7d87cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+17:15758:x1875736500732672:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788842093.289688:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7d87cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+17:15758:x1875736500732672:12345-0@lo:502:mount.lustre.0 Request processed in 252us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842093.289696:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000001:00080000:3.0:1788842093.290015:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788842093.290035:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788842093.290505:0:15758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7607b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788842093.290530:0:15758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500732672:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788842093.290822:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788842093.290880:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788842093.290917:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788842093.291181:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788842093.291225:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788842093.291256:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788842093.291316:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788842093.291354:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788842093.291403:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788842093.291443:0:15758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500732800:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788842093.291511:0:15758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842093.291560:0:15758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7607b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788842093.291685:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500732800 00000100:00100000:0.0:1788842093.291692:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500732800 00000100:00100000:0.0:1788842093.291774:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788842093.291783:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7d87c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+17:15758:x1875736500732800:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788842093.291984:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7d87c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+17:15758:x1875736500732800:12345-0@lo:502:mount.lustre.0 Request processed in 201us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842093.291992:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788842093.292182:0:15758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500732800:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788842093.292266:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788842093.292278:0:15758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788842093.293386:0:15762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788842093.293398:0:15762:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788842093.293405:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788842093.293407:0:15762:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788842093.293412:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788842093.293426:0:15762:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d3a75dd8000) 00000020:00000080:3.0:1788842093.293448:0:15762:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788842093.293453:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788842093.293510:0:15762:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d3a76a92800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788842093.293517:0:15762:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788842093.293523:0:15762:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3de1064d33a8c36b 00010000:00010000:3.0:1788842093.298101:0:15762:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788842093.298541:0:15762:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1788842093.302243:0:15762:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788842093.304109:0:15762:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788842093.304127:0:15762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788842093.304135:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788842093.304138:0:15762:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788842093.304143:0:15762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788842093.304146:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788842093.304147:0:15762:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788842093.304150:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788842093.304153:0:15762:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788842093.304155:0:15762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788842093.304157:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788842093.304159:0:15762:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788842093.304161:0:15762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788842093.304163:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788842093.304175:0:15762:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788842093.304180:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788842093.304244:0:15762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788842093.304247:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788842093.304249:0:15762:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788842093.304254:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788842093.310861:0:15758:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788842093.310912:0:15758:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788842093.310939:0:15758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60052e00/0x3de1064d33a8c356 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c35d expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842093.310954:0:15758:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a60052e00/0x3de1064d33a8c356 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c35d expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788842093.315883:0:15758:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3a76a92800 from 1 10000000:01000000:2.0:1788842093.315893:0:15758:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788842093.316156:0:15758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cd400/0x3de1064d33a8c372 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842093.316169:0:15758:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cd400/0x3de1064d33a8c372 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842093.316183:0:15758:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cd400/0x3de1064d33a8c372 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842093.316213:0:15758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49ade680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500732928:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788842093.316651:0:15758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842093.316778:0:15758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a61969240 going to sleep for 11 seconds 00000100:00100000:3.0:1788842093.319859:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500732928 00000100:00100000:3.0:1788842093.319876:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500732928 00000100:00100000:3.0:1788842093.319989:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788842093.320001:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7d87f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+17:15758:x1875736500732928:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788842093.320019:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842093.320040:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a60052600/0x3de1064d33a8c379 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8c372 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842093.320082:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a60052600/0x3de1064d33a8c379 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8c372 expref: 18 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842093.320109:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a60052600/0x3de1064d33a8c379 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c372 expref: 18 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842093.320119:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a60052600, rc 0) 00000100:00100000:3.0:1788842093.320198:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7d87f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+18:15758:x1875736500732928:12345-0@lo:101:mount.lustre.0 Request processed in 199us (3548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842093.320205:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788842093.321083:0:15758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49ade680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500732928:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788842093.321105:0:15758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cd400/0x3de1064d33a8c372 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c379 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842093.321116:0:15758:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cd400/0x3de1064d33a8c372 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8c379 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788842093.321631:0:15758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788842093.322024:0:15758:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788842093.322254:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788842093.322520:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788842093.322612:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788842093.322621:0:15758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788842093.322697:0:15758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49ade680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500733056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788842093.322801:0:15758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842093.323470:0:15758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a61969240 going to sleep for 11 seconds 00000100:00100000:0.0:1788842093.323548:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500733056 00000100:00100000:0.0:1788842093.323860:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500733056 00000100:00100000:2.0:1788842093.323966:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788842093.323975:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7d87d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+18:15758:x1875736500733056:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788842093.324230:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7d87d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+18:15758:x1875736500733056:12345-0@lo:501:mount.lustre.0 Request processed in 255us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842093.324237:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788842093.324430:0:15758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49ade680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500733056:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788842093.324486:0:15758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500733184:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788842093.324530:0:15758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842093.324563:0:15758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e038840 going to sleep for 11 seconds 00000100:00100000:2.0:1788842093.324667:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500733184 00000100:00100000:2.0:1788842093.324672:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500733184 00000100:00100000:2.0:1788842093.324694:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788842093.324700:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7d87d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+18:15758:x1875736500733184:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788842093.325197:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7d87d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+18:15758:x1875736500733184:12345-0@lo:503:mount.lustre.0 Request processed in 496us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842093.325206:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788842093.325299:0:15758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500733184:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788842093.326199:0:15758:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788842093.326314:0:15758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500733312:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788842093.326370:0:15758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842093.326399:0:15758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e038840 going to sleep for 11 seconds 00000100:00100000:2.0:1788842093.326520:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500733312 00000100:00100000:2.0:1788842093.326527:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500733312 00000100:00100000:2.0:1788842093.326572:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788842093.326581:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7d87dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+18:15758:x1875736500733312:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788842093.326817:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7d87dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+18:15758:x1875736500733312:12345-0@lo:502:mount.lustre.0 Request processed in 237us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842093.326824:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788842093.327232:0:15758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500733312:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788842093.327494:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788842093.327550:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788842093.327615:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788842093.327654:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788842093.327688:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788842093.328016:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788842093.328136:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788842093.328178:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788842093.328216:0:15758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500733440:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788842093.328290:0:15758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842093.328376:0:15758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e038840 going to sleep for 11 seconds 00000100:00100000:1.0:1788842093.329387:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500733440 00000100:00100000:1.0:1788842093.329399:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500733440 00000100:00100000:2.0:1788842093.329493:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788842093.329505:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d394479b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+18:15758:x1875736500733440:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788842093.329775:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d394479b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+18:15758:x1875736500733440:12345-0@lo:502:mount.lustre.0 Request processed in 272us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842093.329782:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788842093.329947:0:15758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500733440:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788842093.330086:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788842093.330100:0:15758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788842093.331236:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788842093.331246:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788842093.331248:0:15766:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788842093.331255:0:15766:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d3a76a92800 00000020:00000080:2.0:1788842093.331257:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788842093.331265:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788842093.331267:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788842093.331268:0:15766:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788842093.331270:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788842093.331273:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788842093.331274:0:15766:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788842093.331277:0:15766:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d3a76a92800 00000020:00000080:2.0:1788842093.331290:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788842093.331355:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788842093.331358:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788842093.331360:0:15766:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788842093.331363:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788842093.331365:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788842093.331366:0:15766:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788842093.331370:0:15766:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d3a76a92800 00000020:00000080:2.0:1788842093.331372:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788842093.331406:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788842093.331410:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788842093.331411:0:15766:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788842093.331414:0:15766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788842093.335391:0:15758:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788842093.335441:0:15758:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788842093.335466:0:15758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cd400/0x3de1064d33a8c372 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c379 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842093.335479:0:15758:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cd400/0x3de1064d33a8c372 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c379 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788842093.335532:0:15758:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788842093.335534:0:15758:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d3a76a92800 10000000:01000000:0.0:1788842093.335537:0:15758:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d3a76a92800 10000000:01000000:0.0:1788842093.335541:0:15758:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788842093.335546:0:15758:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d3a76a92800 from 1 10000000:01000000:0.0:1788842093.335548:0:15758:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788842093.335598:0:15758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a77601a00/0x3de1064d33a8c380 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842093.335606:0:15758:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a77601a00/0x3de1064d33a8c380 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842093.335616:0:15758:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a77601a00/0x3de1064d33a8c380 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842093.335643:0:15758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500733568:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788842093.335742:0:15758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842093.335786:0:15758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e038900 going to sleep for 11 seconds 00000100:00100000:2.0:1788842093.335945:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500733568 00000100:00100000:2.0:1788842093.335953:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500733568 00000100:00100000:2.0:1788842093.335998:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788842093.336007:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3944798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+18:15758:x1875736500733568:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788842093.336029:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842093.336041:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c6cc800/0x3de1064d33a8c387 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8c380 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842093.336064:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c6cc800/0x3de1064d33a8c387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8c380 expref: 19 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842093.336075:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c6cc800/0x3de1064d33a8c387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c380 expref: 19 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842093.336082:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cc800, rc 0) 00000100:00100000:2.0:1788842093.336121:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3944798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:15758:x1875736500733568:12345-0@lo:101:mount.lustre.0 Request processed in 114us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842093.336128:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788842093.342381:0:15758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500733568:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788842093.342412:0:15758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a77601a00/0x3de1064d33a8c380 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c387 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842093.342425:0:15758:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a77601a00/0x3de1064d33a8c380 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8c387 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788842093.343348:0:15758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788842093.343905:0:15758:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788842093.344299:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788842093.344345:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788842093.344378:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788842093.344425:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788842093.344459:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788842093.344505:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788842093.344539:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788842093.347835:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788842093.349718:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788842093.349803:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788842093.349840:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788842093.349898:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788842093.353031:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788842093.353129:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788842093.353208:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788842093.353248:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788842093.353297:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788842093.353349:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788842093.353384:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788842093.353418:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788842093.353464:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788842093.353500:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788842093.353534:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788842093.353773:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788842093.353810:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788842093.353840:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788842093.353886:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788842093.353919:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788842093.354341:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788842093.354394:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1788842093.354432:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1788842093.354461:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1788842093.354493:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1788842093.354701:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1788842093.356866:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1788842093.357098:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1788842093.357139:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1788842093.357239:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1788842093.357248:0:15758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788842093.357369:0:15758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49aded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500733696:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788842093.357438:0:15758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842093.357484:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500733696 00000100:00100000:2.0:1788842093.357492:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500733696 00000100:00100000:2.0:1788842093.361637:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788842093.361657:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3944799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:15758:x1875736500733696:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788842093.361965:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3944799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:15758:x1875736500733696:12345-0@lo:501:mount.lustre.0 Request processed in 314us (4525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842093.361974:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788842093.364982:0:15758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a793c4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788842093.365028:0:15758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49aded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500733696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788842093.365090:0:15758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500733824:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788842093.365176:0:15758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842093.365210:0:15758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e038600 going to sleep for 11 seconds 00000100:00100000:1.0:1788842093.365345:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500733824 00000100:00100000:1.0:1788842093.365353:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500733824 00000100:00100000:1.0:1788842093.365405:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788842093.365414:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d394479a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:15758:x1875736500733824:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788842093.366420:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d394479a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:15758:x1875736500733824:12345-0@lo:503:mount.lustre.0 Request processed in 1003us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842093.366437:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788842093.369177:0:15758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500733824:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788842093.371878:0:15758:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788842093.372748:0:15758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500733952:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788842093.373858:0:15758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842093.374126:0:15758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e038600 going to sleep for 11 seconds 00000100:00100000:1.0:1788842093.374672:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500733952 00000100:00100000:1.0:1788842093.374681:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500733952 00000100:00100000:1.0:1788842093.374748:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788842093.374758:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3944798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:15758:x1875736500733952:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788842093.377460:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3944798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:15758:x1875736500733952:12345-0@lo:502:mount.lustre.0 Request processed in 2694us (3596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842093.377474:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788842093.379101:0:15758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76806680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500733952:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788842093.379415:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788842093.379470:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788842093.379498:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788842093.381301:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788842093.381430:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788842093.381500:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788842093.381535:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788842093.382182:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788842093.382251:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788842093.382306:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788842093.382341:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788842093.382391:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788842093.382427:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788842093.382458:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788842093.382521:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788842093.383256:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788842093.383327:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788842093.383384:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788842093.383422:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788842093.383455:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788842093.383530:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788842093.383580:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788842093.383614:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788842093.383662:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788842093.383696:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788842093.383763:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788842093.383814:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788842093.383864:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788842093.383900:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788842093.384177:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788842093.384221:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788842093.384258:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788842093.384306:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788842093.384357:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788842093.384394:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788842093.384438:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788842093.384771:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788842093.384805:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788842093.384852:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788842093.384886:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788842093.385463:0:15758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500734080:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788842093.385569:0:15758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842093.385632:0:15758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7607b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788842093.385778:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500734080 00000100:00100000:3.0:1788842093.385789:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500734080 00000100:00100000:3.0:1788842093.385849:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788842093.385858:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3944799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:15758:x1875736500734080:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788842093.386154:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3944799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:15758:x1875736500734080:12345-0@lo:502:mount.lustre.0 Request processed in 296us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842093.386163:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788842093.386638:0:15758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500734080:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788842093.386775:0:15758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788842093.386791:0:15758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788842093.388865:0:15771:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788842093.388885:0:15771:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d39462e99b8) 00000020:00000080:1.0:1788842093.388909:0:15771:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1788842093.389006:0:15771:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d3a76a92800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788842093.389011:0:15771:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d3a76a92800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788842093.389020:0:15771:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d3a76a92800 3 00010000:00080000:1.0:1788842093.389645:0:15771:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d3a4e490800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.155@tcp at head 00010000:00010000:1.0:1788842093.392310:0:15771:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1788842093.392512:0:15771:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788842093.392551:0:15771:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788842093.392564:0:15771:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x3de1064d33a8c395 00000100:00080000:1.0:1788842093.392574:0:15771:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788842093.392581:0:15771:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d3a4e490800 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:1.0:1788842093.392620:0:15771:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3a412aa680 x1875736500734208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788842093.392649:0:15771:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788842093.393910:0:482:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788842093.393916:0:482:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788842093.393920:0:482:0:(import.c:65:import_set_state_nolock()) ffff8d3a6fbee000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788842093.393926:0:482:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 416 00000100:00080000:3.0:1788842093.395798:0:482:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788842093.395807:0:482:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d3a6fbee000 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:3.0:1788842093.395839:0:482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3a7c6a4000 x1875736500734464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788842093.395917:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875736500734592:0@lo:400:kworker.0 00000100:00100000:3.0:1788842093.396120:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842093.396175:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788842093.396183:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500734336:0@lo:400:kworker.0 00000100:00100000:3.0:1788842093.396210:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842093.396345:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788842093.396354:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875736500734720:0@lo:400:kworker.0 00000100:00100000:3.0:1788842093.396379:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842093.396408:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500734592 00000100:00100000:3.0:1788842093.396416:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500734592 00000100:00100000:3.0:1788842093.396457:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500734720 00000100:00100000:3.0:1788842093.396460:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500734720 00000100:00100000:3.0:1788842093.396486:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788842093.396495:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875736500734592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788842093.397866:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875736500734592:12345-0@lo:400:kworker.0 Request processed in 1365us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842093.397880:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788842093.397913:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788842093.397925:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875736500734720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788842093.398070:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500734336 00000100:00100000:0.0:1788842093.398078:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500734336 00000100:00100000:0.0:1788842093.398123:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788842093.398130:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500734336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788842093.398190:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500734336:12345-0@lo:400:kworker.0 Request processed in 61us (1979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842093.398196:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788842093.398453:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875736500734720:12345-0@lo:400:kworker.0 Request processed in 533us (2073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842093.398460:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788842093.398485:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788842093.398489:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788842093.398517:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788842093.398538:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500734336:0@lo:400:kworker.0 00010000:00080000:3.0:1788842093.398634:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a7c6a4700 x1875736500734592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788842109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788842093.398646:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875736500734592:0@lo:400:kworker.0 00000100:00100000:1.0:1788842093.398795:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875736500734208:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788842093.398839:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842093.398874:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875736500734464:0@lo:8:kworker.0 00000100:00100000:1.0:1788842093.398901:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842093.398943:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500734464 00000100:00100000:1.0:1788842093.398948:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500734464 00000100:00100000:1.0:1788842093.398980:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788842093.398986:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a412aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1875736500734464:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788842093.399032:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a412aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1875736500734464:12345-0@lo:8:kworker.0 Request processed in 45us (130us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788842093.399211:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788842093.399239:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788842093.399244:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8d3a6fbee000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788842093.399248:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788842093.399251:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875736500734464:0@lo:8:kworker.0 00000100:00100000:3.0:1788842093.399448:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500734208 00000100:00100000:3.0:1788842093.399452:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500734208 00000100:00100000:3.0:1788842093.399473:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788842093.399477:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a412a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1875736500734208:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788842093.399493:0:14360:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 421 last 0 00000020:00000080:3.0:1788842093.399525:0:14360:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3de1064d33a8c39c 00000004:00100000:3.0:1788842093.399539:0:14360:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788842093.399580:0:14360:0:(import.c:65:import_set_state_nolock()) ffff8d3a76abf000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788842093.399624:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a412a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875736500734208:12345-0@lo:38:llog_process_th.0 Request processed in 145us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842093.399630:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788842093.399661:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a412aa680 x1875736500734208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788842103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788842093.399669:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788842093.399674:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788842093.399681:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788842093.399685:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788842093.399687:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8d3a4e490800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788842093.399692:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875736500734208:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788842093.399861:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3a7c6a4e00 x1875736500734720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788842109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788842093.399872:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875736500734720:0@lo:400:kworker.0 00000040:00080000:1.0:1788842093.411938:0:15771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788842093.412070:0:15758:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788842093.412099:0:15758:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788842093.412116:0:15758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a77601a00/0x3de1064d33a8c380 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c387 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842093.412128:0:15758:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a77601a00/0x3de1064d33a8c380 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c387 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788842093.412172:0:15758:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788842093.412175:0:15758:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788842093.412176:0:15758:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788842093.412177:0:15758:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788842093.412178:0:15758:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788842093.412179:0:15758:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788842093.412181:0:15758:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788842093.412182:0:15758:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788842093.412184:0:15758:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788842093.412188:0:15758:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788842093.412190:0:15758:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788842093.412191:0:15758:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788842093.412192:0:15758:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788842093.412193:0:15758:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788842093.412194:0:15758:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788842093.412195:0:15758:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788842093.412196:0:15758:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788842093.412197:0:15758:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788842093.412197:0:15758:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788842093.412220:0:15758:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788842093.412242:0:15758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500734848:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788842093.412338:0:15758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842093.412376:0:15758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7607b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788842093.412401:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500734848 00000100:00100000:1.0:1788842093.412408:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500734848 00000100:00100000:1.0:1788842093.412452:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788842093.412461:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d394479bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:15758:x1875736500734848:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788842093.412493:0:14350:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788842093.412507:0:14350:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788842093.456339:0:14350:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788842093.456360:0:14350:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788842093.456419:0:14374:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788842093.456424:0:14374:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788842093.456445:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8c3a3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842093.456465:0:14374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a7c78ec00/0x3de1064d33a8c27d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c276 expref: 19 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842093.456490:0:14374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8c3a3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842093.456533:0:14374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a7c78ec00/0x3de1064d33a8c27d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8c276 expref: 19 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842093.456548:0:14374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d3a7c78ec00/0x3de1064d33a8c27d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8c276 expref: 19 pid: 14352 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842093.456576:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14374:1875736500734976:0@lo:104: 00000100:00100000:3.0:1788842093.456647:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842093.456696:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788842093.457054:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500734976 00000100:00100000:0.0:1788842093.457062:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500734976 00000100:00100000:0.0:1788842093.457361:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788842093.457373:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6792fa91-218c-4171-b8ed-40bcd3d71b04+3:14374:x1875736500734976:12345-0@lo:104: 00010000:00010000:0.0:1788842093.457389:0:14342:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ea00/0x3de1064d33a8c276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8c27d expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842093.457507:0:14342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788842093.457513:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6792fa91-218c-4171-b8ed-40bcd3d71b04+3:14374:x1875736500734976:12345-0@lo:104: Request processed in 144us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842093.457521:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788842093.457919:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788842093.457940:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ea00/0x3de1064d33a8c276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8c27d expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842093.457949:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24ea00 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:1.0:1788842093.457953:0:14346:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ea00/0x3de1064d33a8c276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8c27d expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842093.457962:0:14346:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ea00/0x3de1064d33a8c276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8c27d expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788842093.457970:0:14346:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ea00/0x3de1064d33a8c276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8c27d expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788842093.457976:0:14346:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788842093.458022:0:14346:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ea00/0x3de1064d33a8c276 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8c27d expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842093.458029:0:14346:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788842093.458057:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ea00/0x3de1064d33a8c276 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8c27d expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842093.458064:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ea00/0x3de1064d33a8c276 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8c27d expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842093.458080:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842093.458082:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842093.458084:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788842093.458108:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6792fa91-218c-4171-b8ed-40bcd3d71b04:3310:1875736500735104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788842093.458148:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842093.458218:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500735104 00000100:00100000:1.0:1788842093.458225:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500735104 00010000:00010000:1.0:1788842093.458246:0:14344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a7c78ec00/0x3de1064d33a8c27d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8c276 expref: 20 pid: 14352 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842093.458268:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788842093.458275:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a412a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6792fa91-218c-4171-b8ed-40bcd3d71b04+20:3310:x1875736500735104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788842093.458297:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788842093.458302:0:14344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a7c78ec00/0x3de1064d33a8c27d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8c276 expref: 20 pid: 14352 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842093.458312:0:14344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a7c78ec00/0x3de1064d33a8c27d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8c276 expref: 20 pid: 14352 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842093.458328:0:14344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8c3a3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842093.458337:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8c3a3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788842093.458350:0:14344:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003208239s 00010000:00010000:1.0:1788842093.458355:0:14344:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8c3a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842093.458361:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8c3a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842093.458367:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8c3a3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842093.458382:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8c3a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842093.458387:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60052000 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842093.458391:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8c3a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842093.458397:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8c3a3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842093.458405:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8c3a3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842093.458413:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788842093.458445:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a412a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6792fa91-218c-4171-b8ed-40bcd3d71b04+20:3310:x1875736500735104:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842093.458451:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788842093.458485:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6792fa91-218c-4171-b8ed-40bcd3d71b04:3310:1875736500735104:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788842093.459896:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a7c78ec00/0x3de1064d33a8c27d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8c276 expref: 19 pid: 14352 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842093.459914:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14374:1875736500734976:0@lo:104: 00010000:00010000:2.0:1788842093.459944:0:14374:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8c3a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842093.459954:0:14374:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8c3a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842093.459977:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8c3a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842093.459984:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a60052000/0x3de1064d33a8c3a3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842093.478759:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d394479bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+18:15758:x1875736500734848:12345-0@lo:253:mount.lustre.0 Request processed in 66286us (66408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842093.478774:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788842093.479104:0:15758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6792fa91-218c-4171-b8ed-40bcd3d71b04:15758:1875736500734848:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788842093.479122:0:15758:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788842093.479126:0:15758:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788842093.479128:0:15758:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788842093.479129:0:15758:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788842093.479130:0:15758:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788842093.479132:0:15758:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788842093.479133:0:15758:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788842093.479135:0:15758:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788842093.479137:0:15758:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788842093.479138:0:15758:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788842093.479160:0:15758:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788842093.486824:0:15758:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788842093.487150:0:15758:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788842093.487350:0:15758:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788842093.487494:0:15758:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788842093.489236:0:15758:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788842093.489510:0:15758:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788842093.490858:0:15758:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788842093.563489:0:15758:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788842093.563500:0:15758:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788842093.563535:0:15758:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788842093.563620:0:15758:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.155@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788842093.563633:0:15758:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788842093.563678:0:15758:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788842094.084824:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788842094.210979:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500735232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788842094.211078:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842094.211225:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500735232 00000100:00100000:2.0:1788842094.211234:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500735232 00000100:00100000:2.0:1788842094.211297:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788842094.211306:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a412ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500735232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788842094.211342:0:15046:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788842094.211401:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a412ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500735232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842094.211409:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788842094.211747:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500735232:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788842095.108240:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788842095.234421:0:14354:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788842095.234429:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d3a4fa2d800 from 8 10000000:01000000:3.0:1788842095.234434:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788842095.234480:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60052a00/0x3de1064d33a8c3aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842095.234493:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a60052a00/0x3de1064d33a8c3aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842095.234503:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a60052a00/0x3de1064d33a8c3aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842095.234561:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500735360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788842095.234634:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842095.234689:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7c7b8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788842095.235126:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500735360 00000100:00100000:0.0:1788842095.235134:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500735360 00000100:00100000:0.0:1788842095.235182:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788842095.235193:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d394479ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+18:14354:x1875736500735360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788842095.235208:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842095.235224:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a77600a00/0x3de1064d33a8c3b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8c3aa expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842095.235258:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a77600a00/0x3de1064d33a8c3b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8c3aa expref: 19 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842095.235270:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a77600a00/0x3de1064d33a8c3b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c3aa expref: 19 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842095.235279:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a77600a00, rc 0) 00000100:00100000:0.0:1788842095.235341:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d394479ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:14354:x1875736500735360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842095.235347:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788842095.235542:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500735360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788842095.235556:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a60052a00/0x3de1064d33a8c3aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c3b1 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842095.235565:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a60052a00/0x3de1064d33a8c3aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8c3b1 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842095.235620:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500735488:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788842095.235652:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842095.235687:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7c7b8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788842095.236162:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500735488 00000100:00100000:0.0:1788842095.236169:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500735488 00000100:00100000:0.0:1788842095.236201:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788842095.236209:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d394479a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:14354:x1875736500735488:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788842095.236225:0:14350:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788842095.236254:0:14350:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788842095.236257:0:14350:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788842095.237693:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d394479a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:14354:x1875736500735488:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1477us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842095.237719:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788842095.244563:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500735488:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788842095.245323:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788842095.245338:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a60052a00/0x3de1064d33a8c3aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c3b1 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842095.245350:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a60052a00/0x3de1064d33a8c3aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c3b1 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788842095.426440:0:14389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788842096.137035:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842097.154025:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842098.178441:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788842098.818324:0:482:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788842098.818331:0:482:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788842098.818335:0:482:0:(import.c:65:import_set_state_nolock()) ffff8d3a6fbee000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788842098.818347:0:482:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d3a6fbee000 using connection 192.168.204.155@tcp/0@lo 00000100:00100000:1.0:1788842098.818371:0:482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3a412a9180 x1875736500735872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788842098.818430:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500736128:0@lo:400:kworker.0 00000100:00100000:3.0:1788842098.818436:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6792fa91-218c-4171-b8ed-40bcd3d71b04:3308:1875736500735616:0@lo:400:kworker.0 00000100:00100000:1.0:1788842098.819202:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842098.819283:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500735744:0@lo:400:kworker.0 00000100:00100000:1.0:1788842098.819315:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842098.819347:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788842098.819353:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500736000:0@lo:400:kworker.0 00000100:00100000:1.0:1788842098.819375:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842098.819686:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500736128 00000100:00100000:1.0:1788842098.819694:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500736128 00000100:00100000:1.0:1788842098.819767:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500736000 00000100:00100000:1.0:1788842098.819771:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500736000 00000100:00100000:1.0:1788842098.819788:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788842098.819797:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a412a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500736128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788842098.819850:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a412a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500736128:12345-0@lo:400:kworker.0 Request processed in 54us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842098.819858:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788842098.819874:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788842098.819881:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a412a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500736000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788842098.819917:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a412a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500736000:12345-0@lo:400:kworker.0 Request processed in 36us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842098.819923:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788842098.819965:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875736500735872:0@lo:8:kworker.0 00000100:00100000:1.0:1788842098.819996:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842098.820026:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500735744 00000100:00100000:0.0:1788842098.820032:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500735744 00000100:00100000:0.0:1788842098.820058:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500735872 00000100:00100000:0.0:1788842098.820061:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500735872 00000100:00100000:0.0:1788842098.820073:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788842098.820081:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a412a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500735744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788842098.820106:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788842098.820115:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788842098.820130:0:15044:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788842098.820130:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a412a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500735744:12345-0@lo:400:kworker.0 Request processed in 44us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842098.820142:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788842098.820148:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3306:x1875736500735872:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788842098.820171:0:15044:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:1.0:1788842098.820274:0:15044:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3de1064d33a8c3b8 00002000:00100000:1.0:1788842098.820287:0:15044:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d3a7c58d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113972 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788842098.820291:0:15044:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788842098.820294:0:15044:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788842098.820771:0:15044:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788842098.820879:0:15044:0:(import.c:65:import_set_state_nolock()) ffff8d3a7c58c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788842098.820928:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875736500735872:12345-0@lo:8:kworker.0 Request processed in 778us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842098.821093:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842098.821136:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500736256:0@lo:400:kworker.0 00000100:00100000:3.0:1788842098.821166:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842098.821359:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500736256 00000100:00100000:3.0:1788842098.821365:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500736256 00000100:00100000:3.0:1788842098.821403:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788842098.821410:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500736256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788842098.821456:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500736256:12345-0@lo:400:kworker.0 Request processed in 47us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842098.821471:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788842098.821491:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788842098.821495:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788842098.821508:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500735616 00000100:00100000:3.0:1788842098.821511:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500735616 00000100:00100000:3.0:1788842098.821535:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788842098.821541:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3944799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:3308:x1875736500735616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788842098.821574:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3944799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:3308:x1875736500735616:12345-0@lo:400:kworker.0 Request processed in 33us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842098.821580:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788842098.823529:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6792fa91-218c-4171-b8ed-40bcd3d71b04:3308:1875736500735616:0@lo:400:kworker.0 00010000:00080000:3.0:1788842098.823551:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a412aa680 x1875736500736256/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788842114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788842098.823563:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500736256:0@lo:400:kworker.0 00000100:00100000:0.0:1788842098.824415:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788842098.825188:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788842098.825361:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a412a9180 x1875736500735872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788842123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788842098.825380:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788842098.825391:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788842098.825396:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788842098.825400:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8d3a6fbee000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788842098.825424:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788842098.825430:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875736500735872:0@lo:8:kworker.0 00000004:00080000:2.0:1788842098.825439:0:14382:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788842098.825488:0:14383:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1788842098.825510:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c782300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14383:1875736500736512:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788842098.825569:0:14383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842098.825590:0:14383:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a793c4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788842098.825604:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788842098.825611:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500736384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788842098.825635:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842098.825670:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500736384 00000100:00100000:1.0:1788842098.825676:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500736384 00000100:00100000:1.0:1788842098.825752:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788842098.825764:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875736500736384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788842098.825795:0:15046:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788842098.825860:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875736500736384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842098.825866:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788842098.825893:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788842098.825928:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7c781c00 x1875736500736384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788842114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788842098.825946:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500736384:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788842098.825985:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a412aaa00 x1875736500736000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788842114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788842098.825995:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500736000:0@lo:400:kworker.0 00000100:00100000:1.0:1788842098.826010:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500735744:0@lo:400:kworker.0 00000004:00080000:2.0:1788842098.826023:0:14382:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 426983313032ns, next at 0ns, rc = 0 00010000:00080000:1.0:1788842098.826047:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a412a8700 x1875736500736128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788842114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788842098.826059:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500736128:0@lo:400:kworker.0 00000100:00100000:1.0:1788842098.826092:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500736512 00000100:00100000:1.0:1788842098.826096:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500736512 00000100:00100000:1.0:1788842098.826114:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788842098.826120:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14383:x1875736500736512:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788842098.840615:0:15044:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788842098.840627:0:15044:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788842098.840634:0:15044:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:1.0:1788842098.860320:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842098.860331:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c3bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.862994:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1788842098.862999:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842098.863009:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c3bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.863042:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c3bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.863053:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c3bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.863060:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c3bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.863340:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788842098.863356:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788842098.863363:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c3bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.863372:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24e000 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842098.863376:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c3bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.863386:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c3bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.863403:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c3bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.863410:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c3bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.863438:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842098.863441:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842098.863442:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788842098.866987:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842098.866999:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dc3e264/0x3de1064d33a8c3c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.867016:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1788842098.867021:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842098.867027:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dc3e264/0x3de1064d33a8c3c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.867041:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002dc3e264/0x3de1064d33a8c3c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.867052:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dc3e264/0x3de1064d33a8c3c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.867059:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002dc3e264/0x3de1064d33a8c3c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.867088:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788842098.867112:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788842098.867120:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002dc3e264/0x3de1064d33a8c3c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.867131:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24f800 already unused, calling callback (ffffffffc1813420) 00010000:00010000:0.0:1788842098.867136:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002dc3e264/0x3de1064d33a8c3c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.867146:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002dc3e264/0x3de1064d33a8c3c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.867166:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002dc3e264/0x3de1064d33a8c3c6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.867192:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002dc3e264/0x3de1064d33a8c3c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.867220:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842098.867222:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842098.867225:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788842098.871327:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842098.871338:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c3cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.871366:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1788842098.871371:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842098.871378:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c3cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.871392:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c3cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.871403:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c3cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.871412:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c3cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.871432:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788842098.871448:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788842098.871454:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c3cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.871462:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24e600 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842098.871467:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c3cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.871477:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c3cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.871506:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c3cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.871514:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c3cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.871532:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842098.871534:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842098.871536:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788842098.871983:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842098.871990:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000675e0eb3/0x3de1064d33a8c3d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.871999:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1788842098.872003:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842098.872007:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000675e0eb3/0x3de1064d33a8c3d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.872017:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000675e0eb3/0x3de1064d33a8c3d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.872025:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000675e0eb3/0x3de1064d33a8c3d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.872033:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000675e0eb3/0x3de1064d33a8c3d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.872060:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788842098.872982:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842098.872991:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c3db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.873005:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1788842098.873008:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842098.873014:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c3db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.873026:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c3db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.873035:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c3db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.873042:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c3db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.873059:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788842098.873069:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788842098.873074:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000675e0eb3/0x3de1064d33a8c3d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.873081:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24ec00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842098.873092:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000675e0eb3/0x3de1064d33a8c3d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.873101:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000675e0eb3/0x3de1064d33a8c3d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.873117:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000675e0eb3/0x3de1064d33a8c3d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.873125:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000675e0eb3/0x3de1064d33a8c3d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.873141:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788842098.873144:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c3db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.873150:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24e800 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842098.873153:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c3db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.873161:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c3db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.873171:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c3db lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.873367:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c3db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.873393:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842098.873395:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842098.873397:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842098.873407:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788842098.873952:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842098.873959:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c3e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.873971:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1788842098.873975:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842098.873980:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.873990:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.873998:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.874004:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c3e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.874020:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788842098.874029:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788842098.874034:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c3e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.874053:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24e000 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842098.874056:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c3e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.874065:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c3e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.874079:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c3e2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.874086:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c3e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.874103:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842098.874105:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842098.874107:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788842098.875635:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842098.875646:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d89f86a/0x3de1064d33a8c3e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.875663:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1788842098.875667:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842098.875672:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d89f86a/0x3de1064d33a8c3e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.875685:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d89f86a/0x3de1064d33a8c3e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.875701:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d89f86a/0x3de1064d33a8c3e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.875729:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d89f86a/0x3de1064d33a8c3e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.875745:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788842098.876126:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842098.876132:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001699b75e/0x3de1064d33a8c3f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.876141:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1788842098.876144:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842098.876148:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001699b75e/0x3de1064d33a8c3f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.876156:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001699b75e/0x3de1064d33a8c3f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.876163:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001699b75e/0x3de1064d33a8c3f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.876169:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001699b75e/0x3de1064d33a8c3f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.876223:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788842098.876235:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788842098.876240:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d89f86a/0x3de1064d33a8c3e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.876248:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24ea00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842098.876252:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d89f86a/0x3de1064d33a8c3e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.876261:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d89f86a/0x3de1064d33a8c3e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.876278:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d89f86a/0x3de1064d33a8c3e9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.876285:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d89f86a/0x3de1064d33a8c3e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.876301:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788842098.876304:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001699b75e/0x3de1064d33a8c3f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.876309:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24f400 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842098.876312:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001699b75e/0x3de1064d33a8c3f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.876331:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001699b75e/0x3de1064d33a8c3f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.876342:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001699b75e/0x3de1064d33a8c3f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.876349:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001699b75e/0x3de1064d33a8c3f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.876362:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842098.876364:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842098.876366:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842098.877051:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788842098.878091:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788842098.883753:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842098.883766:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c3f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.883786:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1788842098.883791:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842098.883797:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c3f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.883811:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c3f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.883822:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c3f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.883837:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c3f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.883866:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788842098.883897:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788842098.883917:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c3f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.883927:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24e600 already unused, calling callback (ffffffffc1813420) 00010000:00010000:3.0:1788842098.883931:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c3f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.883941:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c3f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788842098.884697:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842098.884704:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a707430/0x3de1064d33a8c3fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.884737:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1788842098.884740:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842098.884745:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a707430/0x3de1064d33a8c3fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.884748:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c3f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.884754:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a707430/0x3de1064d33a8c3fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.884757:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c3f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.884763:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a707430/0x3de1064d33a8c3fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.884770:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a707430/0x3de1064d33a8c3fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.884777:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842098.884779:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788842098.884783:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a707430/0x3de1064d33a8c3fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.884787:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788842098.884789:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24fa00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:3.0:1788842098.884792:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a707430/0x3de1064d33a8c3fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.884800:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a707430/0x3de1064d33a8c3fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.884809:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a707430/0x3de1064d33a8c3fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.884817:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a707430/0x3de1064d33a8c3fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.884829:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842098.884835:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842098.884837:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842098.885060:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788842098.885281:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842098.885287:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca26e369/0x3de1064d33a8c405 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.885301:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1788842098.885304:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842098.885309:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca26e369/0x3de1064d33a8c405 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.885317:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca26e369/0x3de1064d33a8c405 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.885324:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca26e369/0x3de1064d33a8c405 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.885467:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca26e369/0x3de1064d33a8c405 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.886123:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788842098.889079:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788842098.889091:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca26e369/0x3de1064d33a8c405 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.889105:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24e400 already unused, calling callback (ffffffffc1813420) 00010000:00010000:3.0:1788842098.889111:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca26e369/0x3de1064d33a8c405 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.889123:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca26e369/0x3de1064d33a8c405 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.889143:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca26e369/0x3de1064d33a8c405 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.889150:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca26e369/0x3de1064d33a8c405 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.889458:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842098.889461:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842098.889463:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788842098.889851:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842098.889859:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c40c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.889872:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1788842098.889876:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842098.889882:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c40c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.889894:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c40c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.889928:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c40c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.889936:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c40c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.890847:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788842098.891503:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842098.891513:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c413 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.891528:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1788842098.891532:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842098.891538:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.891552:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.891563:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.891570:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c413 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.898419:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788842098.898438:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c40c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.898452:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24e000 already unused, calling callback (ffffffffc1813420) 00010000:00010000:0.0:1788842098.898457:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c40c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.898468:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c40c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.898491:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c40c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.898498:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c40c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.898524:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788842098.898539:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c413 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.898546:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24e800 already unused, calling callback (ffffffffc1813420) 00010000:00010000:0.0:1788842098.898549:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c413 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.898557:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c413 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.898568:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c413 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.898576:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842098.898578:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842098.898580:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842098.899182:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788842098.899192:0:15044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c413 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788842098.901668:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842098.901680:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000675e0eb3/0x3de1064d33a8c41a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.901695:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1788842098.901699:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842098.901705:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000675e0eb3/0x3de1064d33a8c41a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.901765:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000675e0eb3/0x3de1064d33a8c41a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.901775:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000675e0eb3/0x3de1064d33a8c41a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.901783:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000675e0eb3/0x3de1064d33a8c41a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.901806:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788842098.902081:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788842098.902089:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000675e0eb3/0x3de1064d33a8c41a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.902097:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24ec00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:0.0:1788842098.902101:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000675e0eb3/0x3de1064d33a8c41a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.902110:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000675e0eb3/0x3de1064d33a8c41a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.902125:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000675e0eb3/0x3de1064d33a8c41a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.902140:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000675e0eb3/0x3de1064d33a8c41a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.902157:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842098.902160:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842098.902161:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788842098.902297:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788842098.906704:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842098.906756:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001699b75e/0x3de1064d33a8c421 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.906780:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1788842098.906786:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842098.906792:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001699b75e/0x3de1064d33a8c421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.906806:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001699b75e/0x3de1064d33a8c421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.906816:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001699b75e/0x3de1064d33a8c421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.906823:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001699b75e/0x3de1064d33a8c421 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.906856:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788842098.910196:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842098.910208:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c428 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.910225:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1788842098.910230:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842098.910237:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.910252:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.910276:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.910285:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c428 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.910308:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788842098.910695:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788842098.910704:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001699b75e/0x3de1064d33a8c421 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.910726:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24f400 already unused, calling callback (ffffffffc1813420) 00010000:00010000:3.0:1788842098.910732:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001699b75e/0x3de1064d33a8c421 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.910753:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001699b75e/0x3de1064d33a8c421 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.910770:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001699b75e/0x3de1064d33a8c421 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.910777:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001699b75e/0x3de1064d33a8c421 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.910794:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788842098.910797:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c428 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.910803:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24e800 already unused, calling callback (ffffffffc1813420) 00010000:00010000:3.0:1788842098.910806:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c428 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.910813:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c428 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.910821:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c428 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.910827:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e73b1fab/0x3de1064d33a8c428 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.910852:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842098.910855:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842098.910857:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842098.911558:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788842098.912232:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842098.912242:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d89f86a/0x3de1064d33a8c42f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.912257:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1788842098.912262:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842098.912268:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d89f86a/0x3de1064d33a8c42f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.912281:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d89f86a/0x3de1064d33a8c42f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.912291:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d89f86a/0x3de1064d33a8c42f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.912297:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d89f86a/0x3de1064d33a8c42f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.912338:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788842098.912746:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842098.912752:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4e48e5f/0x3de1064d33a8c436 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.912760:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1788842098.912763:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842098.912767:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e48e5f/0x3de1064d33a8c436 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.912776:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4e48e5f/0x3de1064d33a8c436 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.912784:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4e48e5f/0x3de1064d33a8c436 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.912791:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e48e5f/0x3de1064d33a8c436 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.912805:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788842098.913205:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842098.913211:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa5313e2/0x3de1064d33a8c43d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.913220:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1788842098.913229:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842098.913234:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa5313e2/0x3de1064d33a8c43d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.913243:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa5313e2/0x3de1064d33a8c43d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.913250:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa5313e2/0x3de1064d33a8c43d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.913257:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa5313e2/0x3de1064d33a8c43d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.913264:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788842098.913798:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842098.913805:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a707430/0x3de1064d33a8c444 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.913815:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1788842098.913818:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842098.913821:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a707430/0x3de1064d33a8c444 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.913831:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a707430/0x3de1064d33a8c444 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.913839:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a707430/0x3de1064d33a8c444 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.913853:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a707430/0x3de1064d33a8c444 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.913861:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788842098.914293:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842098.914298:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c44b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.914307:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1788842098.914310:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842098.914314:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c44b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.914323:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c44b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.914330:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c44b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.914336:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c44b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.914344:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1788842098.914557:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788842098.914566:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d89f86a/0x3de1064d33a8c42f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.914574:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24ea00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:3.0:1788842098.914578:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d89f86a/0x3de1064d33a8c42f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.914586:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d89f86a/0x3de1064d33a8c42f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.914603:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d89f86a/0x3de1064d33a8c42f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.914609:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d89f86a/0x3de1064d33a8c42f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.914629:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788842098.914633:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4e48e5f/0x3de1064d33a8c436 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.914638:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24fe00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:3.0:1788842098.914648:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4e48e5f/0x3de1064d33a8c436 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.914656:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4e48e5f/0x3de1064d33a8c436 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.914665:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4e48e5f/0x3de1064d33a8c436 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.914671:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4e48e5f/0x3de1064d33a8c436 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.914682:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788842098.914686:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa5313e2/0x3de1064d33a8c43d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.914692:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24f200 already unused, calling callback (ffffffffc1813420) 00010000:00010000:3.0:1788842098.914695:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa5313e2/0x3de1064d33a8c43d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.914701:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa5313e2/0x3de1064d33a8c43d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.914725:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa5313e2/0x3de1064d33a8c43d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.914731:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa5313e2/0x3de1064d33a8c43d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.914750:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788842098.914754:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a707430/0x3de1064d33a8c444 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.914759:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24fa00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:3.0:1788842098.914762:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a707430/0x3de1064d33a8c444 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.914769:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a707430/0x3de1064d33a8c444 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.914777:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a707430/0x3de1064d33a8c444 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.914782:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a707430/0x3de1064d33a8c444 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.914792:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788842098.914795:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c44b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.914801:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24e600 already unused, calling callback (ffffffffc1813420) 00010000:00010000:3.0:1788842098.914804:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c44b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.914822:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c44b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.914832:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c44b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.914838:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3323817/0x3de1064d33a8c44b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.914850:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842098.914851:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842098.914853:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842098.915746:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788842098.923693:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788842098.930362:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dc3e264/0x3de1064d33a8c452 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.930413:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1788842098.930419:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842098.930428:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dc3e264/0x3de1064d33a8c452 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.930445:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002dc3e264/0x3de1064d33a8c452 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.930457:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dc3e264/0x3de1064d33a8c452 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842098.930465:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002dc3e264/0x3de1064d33a8c452 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.930628:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788842098.931333:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788842098.931341:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011d99f28/0x3de1064d33a8c459 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.931355:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=427s v=(0 0) 00010000:00010000:0.0:1788842098.931358:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842098.931364:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011d99f28/0x3de1064d33a8c459 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.931374:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011d99f28/0x3de1064d33a8c459 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.931381:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011d99f28/0x3de1064d33a8c459 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.931388:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011d99f28/0x3de1064d33a8c459 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.931412:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788842098.931817:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788842098.931823:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2d97aa0/0x3de1064d33a8c460 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.931832:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=427s v=(0 0) 00010000:00010000:0.0:1788842098.931835:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842098.931839:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d97aa0/0x3de1064d33a8c460 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.931847:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2d97aa0/0x3de1064d33a8c460 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.931854:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2d97aa0/0x3de1064d33a8c460 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.931860:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d97aa0/0x3de1064d33a8c460 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.931867:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788842098.932266:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788842098.932272:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de7ae95a/0x3de1064d33a8c467 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.932280:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=427s v=(0 0) 00010000:00010000:0.0:1788842098.932289:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842098.932293:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de7ae95a/0x3de1064d33a8c467 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.932303:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de7ae95a/0x3de1064d33a8c467 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.932311:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de7ae95a/0x3de1064d33a8c467 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.932317:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de7ae95a/0x3de1064d33a8c467 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.932326:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788842098.932736:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788842098.932742:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075af9b90/0x3de1064d33a8c46e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.932751:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=427s v=(0 0) 00010000:00010000:0.0:1788842098.932755:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842098.932759:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075af9b90/0x3de1064d33a8c46e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.932768:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075af9b90/0x3de1064d33a8c46e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.932775:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075af9b90/0x3de1064d33a8c46e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.932789:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075af9b90/0x3de1064d33a8c46e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.932797:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788842098.933201:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788842098.933207:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002870ce23/0x3de1064d33a8c475 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.933215:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=427s v=(0 0) 00010000:00010000:0.0:1788842098.933217:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842098.933221:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002870ce23/0x3de1064d33a8c475 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.933229:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002870ce23/0x3de1064d33a8c475 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.933236:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002870ce23/0x3de1064d33a8c475 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.933243:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002870ce23/0x3de1064d33a8c475 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.933251:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1788842098.933618:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788842098.933627:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002dc3e264/0x3de1064d33a8c452 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933636:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24f800 already unused, calling callback (ffffffffc1813420) 00010000:00010000:3.0:1788842098.933640:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002dc3e264/0x3de1064d33a8c452 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933649:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002dc3e264/0x3de1064d33a8c452 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933665:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002dc3e264/0x3de1064d33a8c452 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933683:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002dc3e264/0x3de1064d33a8c452 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933706:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788842098.933724:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011d99f28/0x3de1064d33a8c459 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933730:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a77600c00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:3.0:1788842098.933733:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011d99f28/0x3de1064d33a8c459 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933741:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011d99f28/0x3de1064d33a8c459 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933750:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011d99f28/0x3de1064d33a8c459 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933756:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011d99f28/0x3de1064d33a8c459 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933768:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788842098.933771:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2d97aa0/0x3de1064d33a8c460 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933776:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a77601000 already unused, calling callback (ffffffffc1813420) 00010000:00010000:3.0:1788842098.933785:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2d97aa0/0x3de1064d33a8c460 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933792:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2d97aa0/0x3de1064d33a8c460 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933801:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2d97aa0/0x3de1064d33a8c460 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933807:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2d97aa0/0x3de1064d33a8c460 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933818:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788842098.933821:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de7ae95a/0x3de1064d33a8c467 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933827:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a77600800 already unused, calling callback (ffffffffc1813420) 00010000:00010000:3.0:1788842098.933831:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de7ae95a/0x3de1064d33a8c467 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933838:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de7ae95a/0x3de1064d33a8c467 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933846:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de7ae95a/0x3de1064d33a8c467 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933853:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de7ae95a/0x3de1064d33a8c467 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933870:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788842098.933874:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075af9b90/0x3de1064d33a8c46e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933879:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a77601800 already unused, calling callback (ffffffffc1813420) 00010000:00010000:3.0:1788842098.933882:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075af9b90/0x3de1064d33a8c46e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933891:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075af9b90/0x3de1064d33a8c46e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933900:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075af9b90/0x3de1064d33a8c46e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933907:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075af9b90/0x3de1064d33a8c46e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933918:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788842098.933921:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002870ce23/0x3de1064d33a8c475 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933927:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a77600000 already unused, calling callback (ffffffffc1813420) 00010000:00010000:3.0:1788842098.933930:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002870ce23/0x3de1064d33a8c475 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933947:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002870ce23/0x3de1064d33a8c475 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933957:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002870ce23/0x3de1064d33a8c475 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933963:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002870ce23/0x3de1064d33a8c475 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.933976:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842098.933978:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842098.933979:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842098.934061:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788842098.938109:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788842098.938124:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3d81a14/0x3de1064d33a8c47c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.938150:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=427s v=(0 0) 00010000:00010000:0.0:1788842098.938155:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842098.938161:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3d81a14/0x3de1064d33a8c47c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.938185:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3d81a14/0x3de1064d33a8c47c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.938195:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3d81a14/0x3de1064d33a8c47c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.938202:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3d81a14/0x3de1064d33a8c47c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842098.938227:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788842098.938417:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788842098.938424:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3d81a14/0x3de1064d33a8c47c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.938432:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a77601e00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:3.0:1788842098.938437:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3d81a14/0x3de1064d33a8c47c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.938446:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3d81a14/0x3de1064d33a8c47c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.938464:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3d81a14/0x3de1064d33a8c47c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.938483:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3d81a14/0x3de1064d33a8c47c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842098.938503:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842098.938505:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842098.938506:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788842098.939033:0:15044:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1788842098.939212:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14383:x1875736500736512:12345-0@lo:5:osp-pre-1-0.0 Request processed in 113086us (113637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842098.939223:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788842098.948854:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c782300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14383:1875736500736512:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788842098.948875:0:14383:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1788842098.948928:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c782300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14383:1875736500736640:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788842098.948986:0:14383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842098.949047:0:14383:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e1c26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788842098.949115:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500736640 00000100:00100000:3.0:1788842098.949122:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500736640 00000100:00100000:3.0:1788842098.949190:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788842098.949200:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14383:x1875736500736640:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788842098.949246:0:15043:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1788842098.958919:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14383:x1875736500736640:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9714us (9926us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788842098.958934:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788842098.959421:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c782300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14383:1875736500736640:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788842098.959438:0:14383:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1788842099.213379:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788842099.338831:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500736768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788842099.338921:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842099.339200:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500736768 00000100:00100000:2.0:1788842099.339209:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500736768 00000100:00100000:2.0:1788842099.339269:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788842099.339286:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500736768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788842099.339322:0:15046:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788842099.339370:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500736768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842099.339377:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788842099.339472:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500736768:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788842100.227285:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788842100.889494:0:16117:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg455-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788842101.258192:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842102.274620:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842103.308880:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788842103.605819:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842103.605978:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489206272 00000100:00100000:0.0:1788842103.605988:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489206272 00000100:00100000:0.0:1788842103.606065:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 74 00000100:00100000:0.0:1788842103.606095:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2348:x1875736489206272:12345-192.168.204.55@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788842103.606138:0:14350:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4fd51e06-eb1a-40f6-8c4f-348236053b9d@192.168.204.55@tcp t0 exp 0000000000000000 cur 431 last 0 00000020:00000080:0.0:1788842103.606167:0:14350:0:(genops.c:1385:class_connect()) connect: client 4fd51e06-eb1a-40f6-8c4f-348236053b9d, cookie 0x3de1064d33a8c483 00000100:00080000:0.0:1788842103.606299:0:14350:0:(import.c:65:import_set_state_nolock()) ffff8d3a444ef800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788842103.606381:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fd51e06-eb1a-40f6-8c4f-348236053b9d+5:2348:x1875736489206272:12345-192.168.204.55@tcp:250:mount.lustre.0 Request processed in 306us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842103.606390:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 74 00000100:00100000:3.0:1788842103.610340:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842103.610460:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489206400 00000100:00100000:1.0:1788842103.610471:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489206400 00000100:00100000:1.0:1788842103.610541:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 75 00000100:00100000:1.0:1788842103.610552:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fd51e06-eb1a-40f6-8c4f-348236053b9d+5:13759:x1875736489206400:12345-192.168.204.55@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788842103.610569:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788842103.610586:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c24e400/0x3de1064d33a8c48a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef24e0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842103.610616:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c24e400/0x3de1064d33a8c48a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24e0 expref: 6 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842103.610627:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c24e400/0x3de1064d33a8c48a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24e0 expref: 6 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842103.610637:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c24e400, rc 0) 00000100:00100000:1.0:1788842103.610764:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fd51e06-eb1a-40f6-8c4f-348236053b9d+6:13759:x1875736489206400:12345-192.168.204.55@tcp:101:mount.lustre.0 Request processed in 213us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842103.610771:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 75 00000100:00100000:1.0:1788842103.613537:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842103.613666:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489206528 00000100:00100000:0.0:1788842103.613676:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489206528 00000100:00100000:0.0:1788842103.613808:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 76 00000100:00100000:0.0:1788842103.613820:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fd51e06-eb1a-40f6-8c4f-348236053b9d+6:13759:x1875736489206528:12345-192.168.204.55@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788842103.614353:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fd51e06-eb1a-40f6-8c4f-348236053b9d+6:13759:x1875736489206528:12345-192.168.204.55@tcp:501:mount.lustre.0 Request processed in 532us (822us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788842103.614362:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 76 00000100:00100000:2.0:1788842103.622349:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842103.623308:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489206656 00000100:00100000:3.0:1788842103.623327:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489206656 00000100:00100000:3.0:1788842103.623435:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 77 00000100:00100000:3.0:1788842103.623450:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+6:13759:x1875736489206656:12345-192.168.204.55@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788842103.623477:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842103.623505:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a40030000/0x3de1064d33a8c491 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef24e7 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842103.623629:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a40030000/0x3de1064d33a8c491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24e7 expref: 7 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842103.623642:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a40030000/0x3de1064d33a8c491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef24e7 expref: 7 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842103.623654:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40030000, rc 0) 00000100:00100000:3.0:1788842103.626058:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+7:13759:x1875736489206656:12345-192.168.204.55@tcp:101:mount.lustre.0 Request processed in 2593us (3710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842103.626076:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 77 00000100:00100000:3.0:1788842103.639227:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842103.639918:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489206784 00000100:00100000:0.0:1788842103.639946:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489206784 00000100:00100000:0.0:1788842103.640029:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 78 00000100:00100000:0.0:1788842103.640043:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fd51e06-eb1a-40f6-8c4f-348236053b9d+7:13759:x1875736489206784:12345-192.168.204.55@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788842103.640490:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fd51e06-eb1a-40f6-8c4f-348236053b9d+8:13759:x1875736489206784:12345-192.168.204.55@tcp:501:mount.lustre.0 Request processed in 447us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842103.640500:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 78 00000100:00100000:0.0:1788842103.644327:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842103.644578:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489206912 00000100:00100000:3.0:1788842103.644594:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489206912 00000100:00100000:3.0:1788842103.645016:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 79 00000100:00100000:2.0:1788842103.645190:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+8:13759:x1875736489206912:12345-192.168.204.55@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788842103.649217:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+8:13759:x1875736489206912:12345-192.168.204.55@tcp:503:mount.lustre.0 Request processed in 4169us (4888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842103.649237:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 79 00000100:00100000:2.0:1788842103.662673:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842103.663065:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489207040 00000100:00100000:1.0:1788842103.663091:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489207040 00000100:00100000:1.0:1788842103.663173:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 80 00000100:00100000:1.0:1788842103.663190:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fd51e06-eb1a-40f6-8c4f-348236053b9d+8:13778:x1875736489207040:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788842103.669442:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fd51e06-eb1a-40f6-8c4f-348236053b9d+8:13778:x1875736489207040:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 5163us (5690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842103.671075:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 80 00000100:00100000:2.0:1788842103.687135:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842103.687769:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489207168 00000100:00100000:0.0:1788842103.687784:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489207168 00000100:00100000:0.0:1788842103.688064:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 81 00000100:00100000:0.0:1788842103.688077:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+8:13778:x1875736489207168:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788842103.688519:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+8:13778:x1875736489207168:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 443us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842103.688538:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 81 00000100:00100000:0.0:1788842103.703687:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842103.704005:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489207296 00000100:00100000:1.0:1788842103.704021:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489207296 00000100:00100000:1.0:1788842103.704109:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 82 00000100:00100000:1.0:1788842103.704123:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fd51e06-eb1a-40f6-8c4f-348236053b9d+8:13759:x1875736489207296:12345-192.168.204.55@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788842103.704148:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788842103.704176:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c24ec00/0x3de1064d33a8c498 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2511 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842103.704230:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c24ec00/0x3de1064d33a8c498 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2511 expref: 9 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842103.704244:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c24ec00/0x3de1064d33a8c498 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2511 expref: 9 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842103.704255:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c24ec00, rc 0) 00000100:00100000:1.0:1788842103.704332:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fd51e06-eb1a-40f6-8c4f-348236053b9d+9:13759:x1875736489207296:12345-192.168.204.55@tcp:101:mount.lustre.0 Request processed in 212us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842103.704340:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 82 00000100:00100000:2.0:1788842103.707246:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842103.708271:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489207424 00000100:00100000:1.0:1788842103.708291:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489207424 00000100:00100000:1.0:1788842103.708379:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 83 00000100:00100000:1.0:1788842103.708394:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fd51e06-eb1a-40f6-8c4f-348236053b9d+9:13759:x1875736489207424:12345-192.168.204.55@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788842103.708438:0:14350:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788842103.708475:0:14350:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788842103.708480:0:14350:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788842103.708483:0:14350:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788842103.708492:0:14350:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788842103.714550:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fd51e06-eb1a-40f6-8c4f-348236053b9d+9:13759:x1875736489207424:12345-192.168.204.55@tcp:256:mount.lustre.0 Request processed in 6120us (7278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842103.714575:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 83 00000100:00100000:0.0:1788842103.725944:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842103.726165:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489207552 00000100:00100000:2.0:1788842103.726180:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489207552 00000100:00100000:2.0:1788842103.726259:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 84 00000100:00100000:2.0:1788842103.726272:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+9:13759:x1875736489207552:12345-192.168.204.55@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788842103.726293:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842103.726317:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c6cc400/0x3de1064d33a8c49f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2518 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842103.726369:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c6cc400/0x3de1064d33a8c49f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2518 expref: 10 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842103.726383:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c6cc400/0x3de1064d33a8c49f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2518 expref: 10 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842103.726418:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cc400, rc 0) 00000100:00100000:2.0:1788842103.726504:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+10:13759:x1875736489207552:12345-192.168.204.55@tcp:101:mount.lustre.0 Request processed in 235us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842103.726512:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 84 00000100:00100000:2.0:1788842103.738331:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842103.742937:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489207680 00000100:00100000:1.0:1788842103.743121:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489207680 00000100:00100000:0.0:1788842103.743453:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 85 00000100:00100000:0.0:1788842103.743468:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fd51e06-eb1a-40f6-8c4f-348236053b9d+10:13759:x1875736489207680:12345-192.168.204.55@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788842103.744073:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fd51e06-eb1a-40f6-8c4f-348236053b9d+10:13759:x1875736489207680:12345-192.168.204.55@tcp:501:mount.lustre.0 Request processed in 604us (5756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842103.744094:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 85 00000100:00100000:0.0:1788842103.746406:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842103.746506:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489207808 00000100:00100000:3.0:1788842103.746519:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489207808 00000100:00100000:3.0:1788842103.746762:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 86 00000100:00100000:3.0:1788842103.746775:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fd51e06-eb1a-40f6-8c4f-348236053b9d+10:13759:x1875736489207808:12345-192.168.204.55@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788842103.748513:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fd51e06-eb1a-40f6-8c4f-348236053b9d+10:13759:x1875736489207808:12345-192.168.204.55@tcp:503:mount.lustre.0 Request processed in 1727us (2108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842103.748530:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 86 00000100:00100000:1.0:1788842103.757461:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842103.757703:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489207936 00000100:00100000:0.0:1788842103.757754:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489207936 00000100:00100000:0.0:1788842103.757836:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 87 00000100:00100000:0.0:1788842103.757849:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a486c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fd51e06-eb1a-40f6-8c4f-348236053b9d+10:13782:x1875736489207936:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788842103.758288:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a486c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fd51e06-eb1a-40f6-8c4f-348236053b9d+10:13782:x1875736489207936:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 438us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842103.758297:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 87 00000100:00100000:0.0:1788842103.767175:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842103.768299:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489208064 00000100:00100000:3.0:1788842103.768330:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489208064 00000100:00100000:3.0:1788842103.768443:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 88 00000100:00100000:3.0:1788842103.768457:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fd51e06-eb1a-40f6-8c4f-348236053b9d+10:13782:x1875736489208064:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788842103.771424:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fd51e06-eb1a-40f6-8c4f-348236053b9d+10:13782:x1875736489208064:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 2952us (4247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842103.771445:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 88 00000100:00100000:1.0:1788842103.781430:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842103.782147:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489208192 00000100:00100000:3.0:1788842103.782186:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489208192 00000100:00100000:3.0:1788842103.782340:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 4 00000100:00100000:3.0:1788842103.782352:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2348:x1875736489208192:12345-192.168.204.55@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788842103.782402:0:14360:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 10bbae73-32ed-4506-b337-b06c2cb26bae@192.168.204.55@tcp t0 exp 0000000000000000 cur 431 last 0 00000020:00000080:3.0:1788842103.782476:0:14360:0:(genops.c:1385:class_connect()) connect: client 10bbae73-32ed-4506-b337-b06c2cb26bae, cookie 0x3de1064d33a8c4a6 00000004:00100000:3.0:1788842103.782521:0:14360:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:3.0:1788842103.782530:0:14360:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788842103.928977:0:14360:0:(import.c:65:import_set_state_nolock()) ffff8d3a7c7a3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788842103.929136:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+6:2348:x1875736489208192:12345-192.168.204.55@tcp:38:mount.lustre.0 Request processed in 146778us (147718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842103.929150:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 4 00000100:00100000:1.0:1788842103.935979:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842103.936161:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489208320 00000100:00100000:3.0:1788842103.936177:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489208320 00000100:00100000:3.0:1788842103.936367:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 5 00000100:00100000:3.0:1788842103.936381:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+6:0:x1875736489208320:12345-192.168.204.55@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788842103.936443:0:14359:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788842103.936647:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+6:0:x1875736489208320:12345-192.168.204.55@tcp:41:mount.lustre.0 Request processed in 268us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842103.936656:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 5 00000100:00100000:2.0:1788842103.937243:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00080000:1.0:1788842103.937459:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788842103.937632:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489208448 00000100:00100000:3.0:1788842103.937640:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489208448 00000100:00100000:3.0:1788842103.937688:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:3.0:1788842103.937697:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+6:13759:x1875736489208448:12345-192.168.204.55@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788842103.937765:0:14360:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788842103.938325:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6792fa91-218c-4171-b8ed-40bcd3d71b04:3307:1875736500736896:0@lo:400:kworker.0 00000100:00100000:1.0:1788842103.938393:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842103.938448:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500737408:0@lo:400:kworker.0 00000100:00100000:1.0:1788842103.938476:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842103.938501:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788842103.938507:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500737024:0@lo:400:kworker.0 00000100:00100000:1.0:1788842103.938536:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842103.938797:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875736500737536:0@lo:400:kworker.0 00000100:00100000:1.0:1788842103.938981:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842103.939037:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500737152:0@lo:400:kworker.0 00000100:00100000:1.0:1788842103.939066:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842103.939098:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500737664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788842103.939126:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842103.939145:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788842103.939151:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500737280:0@lo:400:kworker.0 00000100:00100000:1.0:1788842103.939173:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842103.939223:0:16010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500737024 00000100:00100000:1.0:1788842103.939230:0:16010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500737024 00000100:00100000:1.0:1788842103.939285:0:16010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500737152 00000100:00100000:1.0:1788842103.939289:0:16010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500737152 00000100:00100000:1.0:1788842103.939314:0:16010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788842103.939322:0:16010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500737024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788842103.939374:0:16010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500737024:12345-0@lo:400:kworker.0 Request processed in 52us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842103.939382:0:16010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788842103.939402:0:16010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788842103.939409:0:16010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1875736500737152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788842103.939442:0:16010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1875736500737152:12345-0@lo:400:kworker.0 Request processed in 33us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842103.939448:0:16010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788842103.939476:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788842103.939480:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788842103.939515:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500737152:0@lo:400:kworker.0 00000100:00100000:0.0:1788842103.939779:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788842103.939798:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788842103.940156:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500736896 00000100:00100000:2.0:1788842103.940164:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500736896 00000100:00100000:2.0:1788842103.940205:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788842103.940215:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:3307:x1875736500736896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788842103.940268:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:3307:x1875736500736896:12345-0@lo:400:kworker.0 Request processed in 55us (1874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842103.940275:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788842103.940309:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500737664 00000100:00100000:2.0:1788842103.940313:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500737664 00000100:00100000:2.0:1788842103.940356:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788842103.940364:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875736500737664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788842103.940395:0:15046:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788842103.940433:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875736500737664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842103.940439:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788842103.940471:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788842103.940487:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500737408 00000100:00100000:2.0:1788842103.940491:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500737408 00000100:00100000:2.0:1788842103.940519:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788842103.940523:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500737536 00000100:00100000:2.0:1788842103.940526:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500737536 00000100:00100000:2.0:1788842103.940550:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788842103.940556:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500737280 00000100:00100000:2.0:1788842103.940559:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500737280 00000100:00100000:2.0:1788842103.940572:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788842103.940589:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788842103.940596:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500737408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788842103.940633:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500737408:12345-0@lo:400:kworker.0 Request processed in 37us (2156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842103.940639:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788842103.940650:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788842103.940656:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788842103.940662:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875736500737536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788842103.940690:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875736500737536:12345-0@lo:400:kworker.0 Request processed in 29us (1709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842103.940696:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788842103.941152:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+6:13759:x1875736489208448:12345-192.168.204.55@tcp:41:mount.lustre.0 Request processed in 3452us (3906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842103.941160:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:3.0:1788842103.941179:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788842103.941185:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500737280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788842103.941233:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500737280:12345-0@lo:400:kworker.0 Request processed in 49us (2059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842103.941239:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788842103.941403:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788842103.941463:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842103.941753:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489208576 00000100:00100000:3.0:1788842103.941759:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489208576 00000100:00100000:3.0:1788842103.941803:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:3.0:1788842103.942390:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+6:13759:x1875736489208576:12345-192.168.204.55@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788842103.942961:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+6:13759:x1875736489208576:12345-192.168.204.55@tcp:40:mount.lustre.0 Request processed in 1148us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842103.942971:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:1.0:1788842103.944039:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500737024:0@lo:400:kworker.0 00010000:00080000:1.0:1788842103.944064:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7c782a00 x1875736500737536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788842119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788842103.944086:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875736500737536:0@lo:400:kworker.0 00000100:00100000:1.0:1788842103.944100:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6792fa91-218c-4171-b8ed-40bcd3d71b04:3307:1875736500736896:0@lo:400:kworker.0 00010000:00080000:1.0:1788842103.944114:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7c780000 x1875736500737408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788842119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788842103.944123:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500737408:0@lo:400:kworker.0 00010000:00080000:1.0:1788842103.944205:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3a7c781880 x1875736500737280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788842119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788842103.944214:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500737280:0@lo:400:kworker.0 00000100:00100000:1.0:1788842103.944239:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500737664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788842103.953813:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842103.953868:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842103.953900:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842103.953962:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489208960 00000100:00100000:1.0:1788842103.953975:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489208960 00000100:00100000:1.0:1788842103.954044:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:1.0:1788842103.954058:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+6:13759:x1875736489208960:12345-192.168.204.55@tcp:33:mount.lustre.0 00000100:00100000:1.0:1788842103.954204:0:16010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489208704 00000100:00100000:1.0:1788842103.954208:0:16010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489208704 00000100:00100000:1.0:1788842103.954232:0:16010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489208832 00000100:00100000:1.0:1788842103.954235:0:16010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489208832 00000100:00100000:1.0:1788842103.954253:0:16010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:1.0:1788842103.954259:0:16010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1875736489208704:12345-192.168.204.55@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788842103.954293:0:16010:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 10bbae73-32ed-4506-b337-b06c2cb26bae@192.168.204.55@tcp t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:1.0:1788842103.954346:0:16010:0:(genops.c:1385:class_connect()) connect: client 10bbae73-32ed-4506-b337-b06c2cb26bae, cookie 0x3de1064d33a8c4ad 00002000:00100000:1.0:1788842103.954363:0:16010:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 10bbae73-32ed-4506-b337-b06c2cb26bae/ffff8d3a77aec800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113972 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788842103.954401:0:16010:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:1.0:1788842103.955071:0:16010:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788842103.955129:0:16010:0:(import.c:65:import_set_state_nolock()) ffff8d3a6fbe9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788842103.955232:0:16010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+6:2348:x1875736489208704:12345-192.168.204.55@tcp:8:mount.lustre.0 Request processed in 971us (1372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842103.955243:0:16010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:1.0:1788842103.955276:0:16010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:1.0:1788842103.955291:0:16010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76805500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1875736489208832:12345-192.168.204.55@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788842103.956442:0:16010:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 10bbae73-32ed-4506-b337-b06c2cb26bae@192.168.204.55@tcp t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:1.0:1788842103.956521:0:16010:0:(genops.c:1385:class_connect()) connect: client 10bbae73-32ed-4506-b337-b06c2cb26bae, cookie 0x3de1064d33a8c4b4 00002000:00100000:1.0:1788842103.956539:0:16010:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 10bbae73-32ed-4506-b337-b06c2cb26bae/ffff8d3a7c4a1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113972 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788842103.956554:0:16010:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1788842103.957513:0:16010:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788842103.958677:0:16010:0:(import.c:65:import_set_state_nolock()) ffff8d3a7c4a5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788842103.959244:0:16010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76805500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+6:2348:x1875736489208832:12345-192.168.204.55@tcp:8:mount.lustre.0 Request processed in 3945us (5335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842103.959259:0:16010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 9 00000004:00080000:0.0:1788842103.961680:0:14361:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 7511us 00000004:00200000:1.0:1788842103.997274:0:14361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788842103.997434:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+6:13759:x1875736489208960:12345-192.168.204.55@tcp:33:mount.lustre.0 Request processed in 43371us (43638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842103.997447:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 0 00000001:00100000:3.0:1788842104.079740:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788842104.079764:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:1.0:1788842104.259378:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842104.260490:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489209088 00000100:00100000:2.0:1788842104.260509:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489209088 00000100:00100000:2.0:1788842104.260614:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:2.0:1788842104.260628:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+6:13803:x1875736489209088:12345-192.168.204.55@tcp:101:mkdir.0 00010000:00010000:2.0:1788842104.260665:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842104.260703:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8c4bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2542 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842104.260857:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c4c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842104.260876:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842104.260893:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788842104.260939:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788842104.260944:0:14357:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788842104.260990:0:14357:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842104.261023:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8c4bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2542 expref: 8 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842104.261046:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c4c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2542 expref: 7 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842104.261056:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a61283200) 00010000:00010000:2.0:1788842104.261059:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788842104.261063:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cd200, rc 0) 00000100:00100000:2.0:1788842104.261158:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+7:13803:x1875736489209088:12345-192.168.204.55@tcp:101:mkdir.0 Request processed in 532us (1798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842104.261166:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 8 00010000:00010000:0.0:1788842104.322039:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788842104.450853:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788842104.450887:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500737792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788842104.451002:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842104.451306:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500737792 00000100:00100000:2.0:1788842104.451319:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500737792 00000100:00100000:2.0:1788842104.451420:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788842104.451434:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500737792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788842104.451468:0:15046:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788842104.451535:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500737792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842104.451543:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788842104.451807:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500737792:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788842105.346029:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788842105.669059:0:14389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788842106.371424:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788842106.441542:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842106.442065:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489209216 00000100:00100000:3.0:1788842106.442078:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489209216 00000100:00100000:0.0:1788842106.444765:0:16232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:0.0:1788842106.444803:0:16232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+7:13855:x1875736489209216:12345-192.168.204.55@tcp:41:lfs.0 00000004:00000024:0.0:1788842106.444884:0:16232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788842106.445006:0:16232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+7:13855:x1875736489209216:12345-192.168.204.55@tcp:41:lfs.0 Request processed in 226us (3487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842106.445015:0:16232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00080000:2.0:1788842106.446478:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788842106.460532:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842106.462863:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489209344 00000100:00100000:2.0:1788842106.462886:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489209344 00000100:00100000:2.0:1788842106.463012:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:2.0:1788842106.463037:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10bbae73-32ed-4506-b337-b06c2cb26bae+6:13855:x1875736489209344:12345-192.168.204.55@tcp:13:lfs.0 00002000:00000024:2.0:1788842106.463092:0:15046:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788842106.463287:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788842106.463397:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10bbae73-32ed-4506-b337-b06c2cb26bae+6:13855:x1875736489209344:12345-192.168.204.55@tcp:13:lfs.0 Request processed in 373us (2881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842106.463406:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:0.0:1788842106.481911:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842106.482075:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489209472 00000100:00100000:2.0:1788842106.482103:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489209472 00000100:00100000:2.0:1788842106.482201:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:2.0:1788842106.482215:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10bbae73-32ed-4506-b337-b06c2cb26bae+6:13855:x1875736489209472:12345-192.168.204.55@tcp:13:lfs.0 00002000:00000024:2.0:1788842106.482268:0:15046:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788842106.482396:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10bbae73-32ed-4506-b337-b06c2cb26bae+6:13855:x1875736489209472:12345-192.168.204.55@tcp:13:lfs.0 Request processed in 184us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842106.482404:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00080000:1.0:1788842106.482597:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788842106.743163:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842106.743656:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489209600 00000100:00100000:2.0:1788842106.743671:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489209600 00000100:00100000:0.0:1788842106.743905:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 90 00000100:00100000:0.0:1788842106.743923:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+10:13884:x1875736489209600:12345-192.168.204.55@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788842106.743945:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842106.743970:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a77601600/0x3de1064d33a8c4c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2549 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842106.744009:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a77601600/0x3de1064d33a8c4c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2549 expref: 11 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842106.744063:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a77601600/0x3de1064d33a8c4c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2549 expref: 11 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842106.744074:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a77601600, rc 0) 00000100:00100000:0.0:1788842106.744156:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+11:13884:x1875736489209600:12345-192.168.204.55@tcp:101:mount.lustre.0 Request processed in 237us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842106.744167:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 90 00000100:00100000:0.0:1788842106.755429:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842106.755607:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489209728 00000100:00100000:2.0:1788842106.755621:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489209728 00000100:00100000:2.0:1788842106.755881:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 91 00000100:00100000:2.0:1788842106.755902:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fd51e06-eb1a-40f6-8c4f-348236053b9d+11:13884:x1875736489209728:12345-192.168.204.55@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788842106.756984:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fd51e06-eb1a-40f6-8c4f-348236053b9d+11:13884:x1875736489209728:12345-192.168.204.55@tcp:501:mount.lustre.0 Request processed in 406us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842106.756998:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 91 00000100:00100000:1.0:1788842106.761954:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842106.762080:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489209856 00000100:00100000:0.0:1788842106.762096:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489209856 00000100:00100000:0.0:1788842106.762180:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 92 00000100:00100000:0.0:1788842106.762193:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+11:13884:x1875736489209856:12345-192.168.204.55@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788842106.762635:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+11:13884:x1875736489209856:12345-192.168.204.55@tcp:503:mount.lustre.0 Request processed in 442us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842106.762646:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 92 00000100:00100000:0.0:1788842106.784093:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842106.786636:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489209984 00000100:00100000:2.0:1788842106.786666:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489209984 00000100:00100000:2.0:1788842106.786805:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 93 00000100:00100000:2.0:1788842106.786820:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fd51e06-eb1a-40f6-8c4f-348236053b9d+11:13893:x1875736489209984:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788842106.787347:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fd51e06-eb1a-40f6-8c4f-348236053b9d+11:13893:x1875736489209984:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 528us (3267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842106.787358:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 93 00000100:00100000:2.0:1788842106.823206:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842106.823346:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489210112 00000100:00100000:0.0:1788842106.823365:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489210112 00000100:00100000:0.0:1788842106.823439:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 94 00000100:00100000:0.0:1788842106.823452:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+11:13893:x1875736489210112:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788842106.825846:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+11:13893:x1875736489210112:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 2377us (2635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842106.825867:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 94 00000100:00100000:3.0:1788842106.850694:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842106.850933:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489210240 00000100:00100000:1.0:1788842106.850947:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489210240 00000100:00100000:1.0:1788842106.851035:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 95 00000100:00100000:1.0:1788842106.851049:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fd51e06-eb1a-40f6-8c4f-348236053b9d+11:13884:x1875736489210240:12345-192.168.204.55@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788842106.851071:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788842106.851108:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c24fa00/0x3de1064d33a8c4d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2573 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842106.851167:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c24fa00/0x3de1064d33a8c4d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2573 expref: 12 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842106.851181:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c24fa00/0x3de1064d33a8c4d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2573 expref: 12 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842106.851193:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c24fa00, rc 0) 00000100:00100000:1.0:1788842106.851264:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fd51e06-eb1a-40f6-8c4f-348236053b9d+12:13884:x1875736489210240:12345-192.168.204.55@tcp:101:mount.lustre.0 Request processed in 220us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842106.851272:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 95 00000100:00100000:1.0:1788842106.866075:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842106.866246:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489210368 00000100:00100000:0.0:1788842106.866277:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489210368 00000100:00100000:0.0:1788842106.866360:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 96 00000100:00100000:0.0:1788842106.866384:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+12:13884:x1875736489210368:12345-192.168.204.55@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788842106.866418:0:14352:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788842106.866439:0:14352:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788842106.866443:0:14352:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788842106.866446:0:14352:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788842106.866449:0:14352:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788842106.874204:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+12:13884:x1875736489210368:12345-192.168.204.55@tcp:256:mount.lustre.0 Request processed in 7810us (8120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842106.874223:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 96 00000100:00100000:3.0:1788842106.878122:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842106.878703:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489210496 00000100:00100000:2.0:1788842106.878753:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489210496 00000100:00100000:2.0:1788842106.878830:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 97 00000100:00100000:2.0:1788842106.878843:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fd51e06-eb1a-40f6-8c4f-348236053b9d+12:13884:x1875736489210496:12345-192.168.204.55@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788842106.878876:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842106.878903:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c6cdc00/0x3de1064d33a8c4d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef257a expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842106.878940:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c6cdc00/0x3de1064d33a8c4d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef257a expref: 13 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842106.878984:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c6cdc00/0x3de1064d33a8c4d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef257a expref: 13 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842106.878994:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cdc00, rc 0) 00000100:00100000:2.0:1788842106.880192:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fd51e06-eb1a-40f6-8c4f-348236053b9d+13:13884:x1875736489210496:12345-192.168.204.55@tcp:101:mount.lustre.0 Request processed in 1344us (2075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842106.880204:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 97 00000100:00100000:1.0:1788842106.886956:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842106.887140:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489210624 00000100:00100000:2.0:1788842106.887162:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489210624 00000100:00100000:2.0:1788842106.887382:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 98 00000100:00100000:2.0:1788842106.887396:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+13:13884:x1875736489210624:12345-192.168.204.55@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788842106.887796:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+13:13884:x1875736489210624:12345-192.168.204.55@tcp:501:mount.lustre.0 Request processed in 402us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842106.887805:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 98 00000100:00100000:0.0:1788842106.890087:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842106.890479:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489210752 00000100:00100000:1.0:1788842106.890491:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489210752 00000100:00100000:1.0:1788842106.890555:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 99 00000100:00100000:1.0:1788842106.890566:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fd51e06-eb1a-40f6-8c4f-348236053b9d+13:13884:x1875736489210752:12345-192.168.204.55@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788842106.890898:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fd51e06-eb1a-40f6-8c4f-348236053b9d+13:13884:x1875736489210752:12345-192.168.204.55@tcp:503:mount.lustre.0 Request processed in 332us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842106.890909:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 99 00000100:00100000:3.0:1788842106.898232:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842106.899233:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489210880 00000100:00100000:1.0:1788842106.899250:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489210880 00000100:00100000:1.0:1788842106.899544:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 100 00000100:00100000:1.0:1788842106.899559:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fd51e06-eb1a-40f6-8c4f-348236053b9d+13:13899:x1875736489210880:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788842106.899966:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fd51e06-eb1a-40f6-8c4f-348236053b9d+13:13899:x1875736489210880:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 410us (1750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842106.899986:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 100 00000100:00100000:3.0:1788842106.903500:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842106.903671:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489211008 00000100:00100000:0.0:1788842106.903685:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489211008 00000100:00100000:0.0:1788842106.903801:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 101 00000100:00100000:0.0:1788842106.903814:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fd51e06-eb1a-40f6-8c4f-348236053b9d+13:13899:x1875736489211008:12345-192.168.204.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788842106.904154:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fd51e06-eb1a-40f6-8c4f-348236053b9d+13:13899:x1875736489211008:12345-192.168.204.55@tcp:502:llog_process_th.0 Request processed in 342us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842106.904163:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 101 00000100:00100000:0.0:1788842106.921976:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842106.922589:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489211136 00000100:00100000:2.0:1788842106.922606:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489211136 00000100:00100000:2.0:1788842106.922683:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:2.0:1788842106.922693:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2348:x1875736489211136:12345-192.168.204.55@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788842106.922781:0:14357:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 36a793d4-b9b8-4df6-a0a0-b45d7f854203@192.168.204.55@tcp t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:2.0:1788842106.922842:0:14357:0:(genops.c:1385:class_connect()) connect: client 36a793d4-b9b8-4df6-a0a0-b45d7f854203, cookie 0x3de1064d33a8c4de 00000004:00100000:2.0:1788842106.922887:0:14357:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:2.0:1788842106.923063:0:14357:0:(import.c:65:import_set_state_nolock()) ffff8d3a43e8f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788842106.923165:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36a793d4-b9b8-4df6-a0a0-b45d7f854203+6:2348:x1875736489211136:12345-192.168.204.55@tcp:38:mount.lustre.0 Request processed in 472us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842106.923195:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:3.0:1788842106.944560:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842106.944784:0:16232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489211392 00000100:00100000:0.0:1788842106.944799:0:16232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489211392 00000100:00100000:0.0:1788842106.944898:0:16232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:0.0:1788842106.944911:0:16232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36a793d4-b9b8-4df6-a0a0-b45d7f854203+6:13884:x1875736489211392:12345-192.168.204.55@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788842106.944974:0:16232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788842106.945088:0:16232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36a793d4-b9b8-4df6-a0a0-b45d7f854203+6:13884:x1875736489211392:12345-192.168.204.55@tcp:41:mount.lustre.0 Request processed in 180us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842106.945097:0:16232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00080000:1.0:1788842106.945406:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788842106.974657:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842106.974813:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842106.975334:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489211264 00000100:00100000:3.0:1788842106.975348:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489211264 00000100:00100000:3.0:1788842106.975409:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489211520 00000100:00100000:3.0:1788842106.975413:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489211520 00000100:00100000:3.0:1788842106.975453:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:3.0:1788842106.975466:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a793d4-b9b8-4df6-a0a0-b45d7f854203+7:0:x1875736489211264:12345-192.168.204.55@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788842106.975527:0:14360:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788842106.975620:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a793d4-b9b8-4df6-a0a0-b45d7f854203+7:0:x1875736489211264:12345-192.168.204.55@tcp:41:mount.lustre.0 Request processed in 156us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842106.975628:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:3.0:1788842106.975649:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:3.0:1788842106.975657:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a793d4-b9b8-4df6-a0a0-b45d7f854203+6:13884:x1875736489211520:12345-192.168.204.55@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788842106.975705:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a793d4-b9b8-4df6-a0a0-b45d7f854203+6:13884:x1875736489211520:12345-192.168.204.55@tcp:40:mount.lustre.0 Request processed in 49us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842106.975744:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:2.0:1788842106.979332:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842106.979380:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842106.979421:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842106.979589:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489211648 00000100:00100000:1.0:1788842106.979603:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489211648 00000100:00100000:1.0:1788842106.979657:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489211776 00000100:00100000:1.0:1788842106.979661:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489211776 00000100:00100000:1.0:1788842106.979702:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:1.0:1788842106.979750:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875736489211648:12345-192.168.204.55@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788842106.979808:0:15044:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 36a793d4-b9b8-4df6-a0a0-b45d7f854203@192.168.204.55@tcp t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:1.0:1788842106.979853:0:15044:0:(genops.c:1385:class_connect()) connect: client 36a793d4-b9b8-4df6-a0a0-b45d7f854203, cookie 0x3de1064d33a8c4e5 00002000:00100000:1.0:1788842106.979869:0:15044:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 36a793d4-b9b8-4df6-a0a0-b45d7f854203/ffff8d3a7c4a7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113972 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788842106.979882:0:15044:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:1.0:1788842106.980052:0:15044:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788842106.980092:0:15044:0:(import.c:65:import_set_state_nolock()) ffff8d3a7c4a2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788842106.980180:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36a793d4-b9b8-4df6-a0a0-b45d7f854203+6:2348:x1875736489211648:12345-192.168.204.55@tcp:8:mount.lustre.0 Request processed in 430us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842106.980189:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:1.0:1788842106.980210:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:1.0:1788842106.980215:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875736489211776:12345-192.168.204.55@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788842106.980233:0:15044:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 36a793d4-b9b8-4df6-a0a0-b45d7f854203@192.168.204.55@tcp t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:1.0:1788842106.980254:0:15044:0:(genops.c:1385:class_connect()) connect: client 36a793d4-b9b8-4df6-a0a0-b45d7f854203, cookie 0x3de1064d33a8c4ec 00002000:00100000:1.0:1788842106.980260:0:15044:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 36a793d4-b9b8-4df6-a0a0-b45d7f854203/ffff8d3a7c4a6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113972 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788842106.980286:0:15044:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1788842106.980366:0:15044:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788842106.980382:0:15044:0:(import.c:65:import_set_state_nolock()) ffff8d3a7c4a1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788842106.980409:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36a793d4-b9b8-4df6-a0a0-b45d7f854203+6:2348:x1875736489211776:12345-192.168.204.55@tcp:8:mount.lustre.0 Request processed in 192us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842106.980416:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:0.0:1788842106.981189:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489211904 00000100:00100000:0.0:1788842106.981213:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489211904 00000100:00100000:0.0:1788842106.981271:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 1 00000100:00100000:0.0:1788842106.981281:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36a793d4-b9b8-4df6-a0a0-b45d7f854203+6:13884:x1875736489211904:12345-192.168.204.55@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788842106.981392:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788842106.981468:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36a793d4-b9b8-4df6-a0a0-b45d7f854203+6:13884:x1875736489211904:12345-192.168.204.55@tcp:33:mount.lustre.0 Request processed in 188us (2152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842106.981475:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 1 00000100:00100000:2.0:1788842107.287734:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842107.287841:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489212032 00000100:00100000:3.0:1788842107.287851:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489212032 00000100:00100000:3.0:1788842107.287918:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 14 00000100:00100000:3.0:1788842107.287928:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a793d4-b9b8-4df6-a0a0-b45d7f854203+6:13920:x1875736489212032:12345-192.168.204.55@tcp:101:mkdir.0 00010000:00010000:3.0:1788842107.287947:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842107.287969:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030a00/0x3de1064d33a8c4f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef25a4 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842107.288052:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030400/0x3de1064d33a8c4fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842107.288066:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030400/0x3de1064d33a8c4fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842107.288080:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030400/0x3de1064d33a8c4fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788842107.288285:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788842107.288301:0:14360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788842107.288325:0:14360:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030400/0x3de1064d33a8c4fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842107.288350:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030a00/0x3de1064d33a8c4f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25a4 expref: 8 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842107.288370:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030400/0x3de1064d33a8c4fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25a4 expref: 7 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842107.288378:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a61283200) 00010000:00010000:3.0:1788842107.288381:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788842107.288384:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40030400, rc 0) 00000100:00100000:3.0:1788842107.288446:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a793d4-b9b8-4df6-a0a0-b45d7f854203+7:13920:x1875736489212032:12345-192.168.204.55@tcp:101:mkdir.0 Request processed in 519us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842107.288453:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 14 00010000:00010000:0.0:1788842107.394000:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842108.418334:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788842108.619287:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 36a793d4-b9b8-4df6-a0a0-b45d7f854203 00000001:00100000:3.0:1788842108.619304:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 10bbae73-32ed-4506-b337-b06c2cb26bae 00000100:00100000:1.0:1788842109.059018:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6792fa91-218c-4171-b8ed-40bcd3d71b04:3307:1875736500737920:0@lo:400:kworker.0 00000100:00100000:1.0:1788842109.059094:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842109.059143:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500738432:0@lo:400:kworker.0 00000100:00100000:1.0:1788842109.059171:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842109.059196:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788842109.059201:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500738048:0@lo:400:kworker.0 00000100:00100000:1.0:1788842109.059224:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842109.059240:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875736500738560:0@lo:400:kworker.0 00000100:00100000:1.0:1788842109.059260:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842109.059286:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500738176:0@lo:400:kworker.0 00000100:00100000:1.0:1788842109.059309:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842109.059326:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788842109.059332:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500738304:0@lo:400:kworker.0 00000100:00100000:1.0:1788842109.059352:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842109.059383:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500737920 00000100:00100000:1.0:1788842109.059389:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500737920 00000100:00100000:1.0:1788842109.059437:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788842109.059445:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:3307:x1875736500737920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788842109.059492:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:3307:x1875736500737920:12345-0@lo:400:kworker.0 Request processed in 47us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842109.059510:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788842109.059543:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500738432 00000100:00100000:1.0:1788842109.059547:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500738432 00000100:00100000:1.0:1788842109.059579:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500738560 00000100:00100000:1.0:1788842109.059582:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500738560 00000100:00100000:1.0:1788842109.059593:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500738304 00000100:00100000:1.0:1788842109.059596:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500738304 00000100:00100000:1.0:1788842109.059609:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788842109.059615:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500738432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788842109.059645:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500738432:12345-0@lo:400:kworker.0 Request processed in 31us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842109.059651:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788842109.059663:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788842109.059669:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875736500738560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788842109.059695:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875736500738560:12345-0@lo:400:kworker.0 Request processed in 26us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842109.059701:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788842109.059738:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788842109.059745:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500738304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788842109.059776:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500738304:12345-0@lo:400:kworker.0 Request processed in 32us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842109.059782:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788842109.059800:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500738048 00000100:00100000:1.0:1788842109.059803:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500738048 00000100:00100000:1.0:1788842109.059823:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500738176 00000100:00100000:1.0:1788842109.059825:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500738176 00000100:00100000:1.0:1788842109.059841:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788842109.059853:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500738048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788842109.059882:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500738048:12345-0@lo:400:kworker.0 Request processed in 30us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842109.059888:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788842109.059899:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788842109.059904:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500738176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788842109.059929:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500738176:12345-0@lo:400:kworker.0 Request processed in 25us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842109.059934:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788842109.059959:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788842109.059963:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788842109.059966:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788842109.060008:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500738304:0@lo:400:kworker.0 00000100:00100000:1.0:1788842109.060017:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788842109.060030:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500738176:0@lo:400:kworker.0 00000100:00100000:1.0:1788842109.060057:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500738048:0@lo:400:kworker.0 00000100:00100000:1.0:1788842109.060066:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875736500738560:0@lo:400:kworker.0 00000100:00100000:1.0:1788842109.060074:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6792fa91-218c-4171-b8ed-40bcd3d71b04:3307:1875736500737920:0@lo:400:kworker.0 00000100:00100000:1.0:1788842109.060083:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500738432:0@lo:400:kworker.0 00000100:00100000:2.0:1788842109.060204:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788842109.060214:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500738688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788842109.060246:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842109.060274:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500738688 00000100:00100000:2.0:1788842109.060278:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500738688 00000100:00100000:2.0:1788842109.060302:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788842109.060309:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500738688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788842109.060335:0:15046:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788842109.060371:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500738688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842109.060377:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788842109.060647:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500738688:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788842109.147399:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 36a793d4-b9b8-4df6-a0a0-b45d7f854203 00000001:00100000:3.0:1788842109.147414:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 10bbae73-32ed-4506-b337-b06c2cb26bae 00000001:00100000:2.0:1788842109.159116:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 10bbae73-32ed-4506-b337-b06c2cb26bae 00000001:00100000:2.0:1788842109.159131:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 36a793d4-b9b8-4df6-a0a0-b45d7f854203 00010000:00010000:0.0:1788842109.442837:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788842109.572940:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500738816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788842109.573036:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842109.573337:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500738816 00000100:00100000:2.0:1788842109.573347:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500738816 00000100:00100000:2.0:1788842109.573399:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788842109.573409:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500738816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788842109.573448:0:15046:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788842109.573505:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500738816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842109.573525:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788842109.573614:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500738816:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788842110.466036:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788842110.919587:0:16322:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788842111.490317:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788842112.421259:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842112.421317:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842112.421473:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489212160 00000100:00100000:1.0:1788842112.421486:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489212160 00000100:00100000:1.0:1788842112.421546:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 103 00000100:00100000:1.0:1788842112.421556:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a434c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+13:2352:x1875736489212160:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788842112.421668:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a434c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+13:2352:x1875736489212160:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 113us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842112.421678:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 103 00000100:00100000:3.0:1788842112.422164:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842112.422227:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489212416 00000100:00100000:1.0:1788842112.422232:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489212416 00000100:00100000:1.0:1788842112.422287:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:1.0:1788842112.422297:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+5:2352:x1875736489212416:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788842112.422335:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+5:2352:x1875736489212416:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 41us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842112.422342:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00080000:1.0:1788842112.422362:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788842112.425792:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489212288 00000100:00100000:2.0:1788842112.425815:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489212288 00000100:00080000:1.0:1788842112.425873:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788842112.425908:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:2.0:1788842112.425932:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+6:2351:x1875736489212288:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788842112.426039:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+6:2351:x1875736489212288:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 110us (4721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842112.427298:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842112.427459:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842112.427493:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842112.427530:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842112.427581:0:16010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489212544 00000100:00100000:3.0:1788842112.427590:0:16010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489212544 00000100:00100000:3.0:1788842112.427648:0:16010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489212800 00000100:00100000:3.0:1788842112.427652:0:16010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489212800 00000100:00100000:3.0:1788842112.427666:0:16010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489212928 00000100:00100000:3.0:1788842112.427668:0:16010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489212928 00000100:00100000:3.0:1788842112.427682:0:16010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:3.0:1788842112.427691:0:16010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+5:2351:x1875736489212544:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788842112.427778:0:16010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+5:2351:x1875736489212544:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 88us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842112.427786:0:16010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:3.0:1788842112.427803:0:16010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:3.0:1788842112.427809:0:16010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36a793d4-b9b8-4df6-a0a0-b45d7f854203+5:2351:x1875736489212800:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788842112.427830:0:16010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36a793d4-b9b8-4df6-a0a0-b45d7f854203+5:2351:x1875736489212800:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 22us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842112.427836:0:16010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:3.0:1788842112.427847:0:16010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:3.0:1788842112.427853:0:16010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36a793d4-b9b8-4df6-a0a0-b45d7f854203+5:2352:x1875736489212928:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788842112.427874:0:16010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36a793d4-b9b8-4df6-a0a0-b45d7f854203+5:2352:x1875736489212928:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 22us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842112.427881:0:16010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:3.0:1788842112.427898:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489212672 00000100:00100000:3.0:1788842112.427902:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489212672 00000100:00100000:2.0:1788842112.431150:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:3.0:1788842112.431306:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 18 00000100:00100000:3.0:1788842112.431336:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36a793d4-b9b8-4df6-a0a0-b45d7f854203+6:2352:x1875736489212672:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788842112.431698:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36a793d4-b9b8-4df6-a0a0-b45d7f854203+6:2352:x1875736489212672:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 372us (4237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842112.431726:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 18 00000100:00080000:3.0:1788842112.431772:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788842112.431779:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788842112.431782:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788842112.515159:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842113.538944:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788842114.181062:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c6a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6792fa91-218c-4171-b8ed-40bcd3d71b04:3307:1875736500738944:0@lo:400:kworker.0 00000100:00100000:3.0:1788842114.181137:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842114.181185:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500739456:0@lo:400:kworker.0 00000100:00100000:3.0:1788842114.181224:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842114.181250:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788842114.181256:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500739072:0@lo:400:kworker.0 00000100:00100000:3.0:1788842114.181283:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842114.181301:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875736500739584:0@lo:400:kworker.0 00000100:00100000:3.0:1788842114.181323:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842114.181353:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500739200:0@lo:400:kworker.0 00000100:00100000:3.0:1788842114.181378:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842114.181821:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788842114.181830:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a412aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500739328:0@lo:400:kworker.0 00000100:00100000:3.0:1788842114.181860:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842114.181913:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500738944 00000100:00100000:3.0:1788842114.181921:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500738944 00000100:00100000:3.0:1788842114.181970:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788842114.181978:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:3307:x1875736500738944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788842114.182034:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:3307:x1875736500738944:12345-0@lo:400:kworker.0 Request processed in 56us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842114.182042:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788842114.182072:0:16232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500739456 00000100:00100000:3.0:1788842114.182076:0:16232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500739456 00000100:00100000:3.0:1788842114.182107:0:16232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500739584 00000100:00100000:3.0:1788842114.182109:0:16232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500739584 00000100:00100000:3.0:1788842114.182120:0:16232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500739328 00000100:00100000:3.0:1788842114.182122:0:16232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500739328 00000100:00100000:3.0:1788842114.182133:0:16232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788842114.182139:0:16232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a412ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500739456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788842114.184216:0:16232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a412ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500739456:12345-0@lo:400:kworker.0 Request processed in 31us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842114.184243:0:16232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788842114.184279:0:16232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788842114.184291:0:16232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875736500739584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788842114.184368:0:16232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875736500739584:12345-0@lo:400:kworker.0 Request processed in 82us (3043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842114.184374:0:16232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788842114.184386:0:16232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788842114.184530:0:16232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500739328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788842114.184580:0:16232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875736500739328:12345-0@lo:400:kworker.0 Request processed in 188us (2719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842114.184587:0:16232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788842114.184617:0:16010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500739072 00000100:00100000:3.0:1788842114.184623:0:16010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500739072 00000100:00100000:3.0:1788842114.184662:0:16010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500739200 00000100:00100000:3.0:1788842114.184675:0:16010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500739200 00000100:00100000:3.0:1788842114.184703:0:16010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788842114.184914:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875736500739328:0@lo:400:kworker.0 00000100:00100000:3.0:1788842114.184969:0:16010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500739072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788842114.185010:0:16010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500739072:12345-0@lo:400:kworker.0 Request processed in 301us (3725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842114.185017:0:16010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788842114.185032:0:16010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788842114.185038:0:16010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500739200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788842114.185115:0:16010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500739200:12345-0@lo:400:kworker.0 Request processed in 77us (3736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842114.185121:0:16010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788842114.185159:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788842114.185163:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788842114.185165:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788842114.188583:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500739072:0@lo:400:kworker.0 00000100:00100000:3.0:1788842114.188604:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875736500739584:0@lo:400:kworker.0 00000100:00100000:3.0:1788842114.188616:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c6a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6792fa91-218c-4171-b8ed-40bcd3d71b04:3307:1875736500738944:0@lo:400:kworker.0 00000100:00100000:3.0:1788842114.188627:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500739456:0@lo:400:kworker.0 00000100:00100000:3.0:1788842114.190315:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788842114.190335:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c4b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500739712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788842114.191198:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842114.191411:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500739712 00000100:00100000:2.0:1788842114.191421:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500739712 00000100:00100000:2.0:1788842114.191480:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788842114.191491:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500739712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788842114.191535:0:15046:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788842114.191600:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500739712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842114.191607:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788842114.191962:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c4b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500739712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788842114.199267:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a412ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500739200:0@lo:400:kworker.0 00010000:00010000:0.0:1788842114.561967:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788842114.691006:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500739840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788842114.691086:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842114.691430:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500739840 00000100:00100000:2.0:1788842114.691439:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500739840 00000100:00100000:2.0:1788842114.691495:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788842114.691504:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500739840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788842114.691542:0:15046:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788842114.691609:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500739840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842114.691617:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788842114.691793:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500739840:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1788842115.119390:0:16472:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd13248bd0 20000000:00000080:3.0:1788842115.119412:0:16472:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d3945cf3c00 uarg=0000000000000000 20000000:01000000:3.0:1788842115.119451:0:16472:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788842115.119457:0:16472:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788842115.119461:0:16472:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788842115.124494:0:16473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1788842115.124951:0:16472:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788842115.133269:0:16472:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788842115.133309:0:16472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d3a40030a00/0x3de1064d33a8c501 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842115.133332:0:16472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8c1f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c1f1 expref: 18 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842115.133340:0:16472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a7c24e200/0x3de1064d33a8c245 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c23e expref: 18 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842115.133347:0:16472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a60052600/0x3de1064d33a8c379 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c372 expref: 18 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842115.133356:0:16472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a7c6cc400/0x3de1064d33a8c49f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2518 expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842115.133363:0:16472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3a7c6cdc00/0x3de1064d33a8c4d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef257a expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842115.133369:0:16472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d3a40030a00/0x3de1064d33a8c501 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842115.133421:0:16472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a7c6cdc00/0x3de1064d33a8c4d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef257a expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842115.133460:0:16472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d3a7c6cdc00/0x3de1064d33a8c4d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef257a expref: 12 pid: 14350 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842115.133477:0:16472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c4b3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1875736500739968:192.168.204.55@tcp:104: 00010000:00010000:3.0:1788842115.134002:0:16472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a7c6cc400/0x3de1064d33a8c49f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2518 expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842115.134012:0:16472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d3a7c6cc400/0x3de1064d33a8c49f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2518 expref: 12 pid: 14352 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842115.134022:0:16472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c4b2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1875736500740096:192.168.204.55@tcp:104: 00010000:00010000:3.0:1788842115.134063:0:16472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a60052600/0x3de1064d33a8c379 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8c372 expref: 18 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842115.134071:0:16472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d3a60052600/0x3de1064d33a8c379 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8c372 expref: 18 pid: 14351 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842115.134080:0:16472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c4b0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1875736500740224:0@lo:104: 00000100:00100000:3.0:1788842115.134119:0:16472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842115.134262:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500740224 00000100:00100000:1.0:1788842115.134271:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500740224 00000100:00100000:1.0:1788842115.134328:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788842115.134338:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6792fa91-218c-4171-b8ed-40bcd3d71b04+3:16472:x1875736500740224:12345-0@lo:104: 00010000:00010000:1.0:1788842115.134350:0:14341:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cd400/0x3de1064d33a8c372 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8c379 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842115.134415:0:16472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a7c24e200/0x3de1064d33a8c245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8c23e expref: 18 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842115.134424:0:16472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d3a7c24e200/0x3de1064d33a8c245 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8c23e expref: 18 pid: 14352 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842115.134433:0:16472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c4b2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1875736500740352:0@lo:104: 00010000:00010000:1.0:1788842115.135382:0:14341:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788842115.135394:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6792fa91-218c-4171-b8ed-40bcd3d71b04+3:16472:x1875736500740224:12345-0@lo:104: Request processed in 1054us (1271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842115.135404:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788842115.135461:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788842115.135470:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cd400/0x3de1064d33a8c372 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8c379 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.135480:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd400 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:1.0:1788842115.135485:0:14346:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cd400/0x3de1064d33a8c372 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8c379 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.135495:0:14346:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cd400/0x3de1064d33a8c372 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8c379 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788842115.135502:0:14346:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cd400/0x3de1064d33a8c372 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8c379 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788842115.135508:0:14346:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788842115.135549:0:14346:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cd400/0x3de1064d33a8c372 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8c379 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.135556:0:14346:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788842115.135576:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cd400/0x3de1064d33a8c372 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8c379 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.135583:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cd400/0x3de1064d33a8c372 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8c379 expref: -99 pid: 15758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.135595:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842115.135596:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842115.135598:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788842115.135622:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6792fa91-218c-4171-b8ed-40bcd3d71b04:3307:1875736500740480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788842115.135657:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842115.135738:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500740480 00000100:00100000:1.0:1788842115.135744:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500740480 00010000:00010000:1.0:1788842115.135769:0:14344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a60052600/0x3de1064d33a8c379 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8c372 expref: 19 pid: 14351 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842115.135794:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788842115.135802:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:3307:x1875736500740480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788842115.135813:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788842115.135818:0:14344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a60052600/0x3de1064d33a8c379 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8c372 expref: 19 pid: 14351 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.135829:0:14344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a60052600/0x3de1064d33a8c379 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8c372 expref: 19 pid: 14351 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.135847:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788842115.135886:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:3307:x1875736500740480:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842115.135892:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788842115.135928:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6792fa91-218c-4171-b8ed-40bcd3d71b04:3307:1875736500740480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788842115.136699:0:16472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788842115.136790:0:16472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8c1f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3de1064d33a8c1f1 expref: 18 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842115.136803:0:16472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8c1f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3de1064d33a8c1f1 expref: 18 pid: 14351 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842115.136815:0:16472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c4b3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1875736500740608:0@lo:104: 00000100:00100000:3.0:1788842115.136844:0:16472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842115.136869:0:16472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a429d8cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1788842115.136890:0:16472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a60052600/0x3de1064d33a8c379 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8c372 expref: 18 pid: 14351 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842115.136902:0:16472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c4b0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1875736500740224:0@lo:104: 00000100:00100000:1.0:1788842115.137053:0:14342:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788842115.137065:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500740352 00000100:00100000:1.0:1788842115.137070:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500740352 00000100:00100000:1.0:1788842115.137099:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500740608 00000100:00100000:1.0:1788842115.137102:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500740608 00000100:00100000:1.0:1788842115.137114:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788842115.137122:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6792fa91-218c-4171-b8ed-40bcd3d71b04+4:16472:x1875736500740352:12345-0@lo:104: 00010000:00010000:1.0:1788842115.140951:0:14342:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a60053400/0x3de1064d33a8c23e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8c245 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.141093:0:14342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788842115.141105:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6792fa91-218c-4171-b8ed-40bcd3d71b04+4:16472:x1875736500740352:12345-0@lo:104: Request processed in 3979us (4403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842115.141116:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788842115.141170:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788842115.141182:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c598c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6792fa91-218c-4171-b8ed-40bcd3d71b04+3:16472:x1875736500740608:12345-0@lo:104: 00010000:00010000:1.0:1788842115.141198:0:14342:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c1f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8c1f8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.141234:0:14342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788842115.141239:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c598c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6792fa91-218c-4171-b8ed-40bcd3d71b04+3:16472:x1875736500740608:12345-0@lo:104: Request processed in 62us (4394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842115.141244:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788842115.141877:0:16472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c4b2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1875736500740352:0@lo:104: 00000100:00100000:3.0:1788842115.141891:0:16472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c4b3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1875736500740608:0@lo:104: 00010000:00010000:1.0:1788842115.141979:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788842115.141987:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a60053400/0x3de1064d33a8c23e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8c245 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.141996:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a60053400 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:1.0:1788842115.142001:0:14347:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a60053400/0x3de1064d33a8c23e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8c245 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.142011:0:14347:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a60053400/0x3de1064d33a8c23e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8c245 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788842115.142019:0:14347:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a60053400/0x3de1064d33a8c23e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8c245 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788842115.142024:0:14347:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788842115.142120:0:14347:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a60053400/0x3de1064d33a8c23e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8c245 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.142127:0:14347:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788842115.142225:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a60053400/0x3de1064d33a8c23e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8c245 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.142233:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a60053400/0x3de1064d33a8c23e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8c245 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.142251:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788842115.142254:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c1f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3de1064d33a8c1f8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.142260:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c78e200 already unused, calling callback (ffffffffc1e0dc20) 10000000:00010000:1.0:1788842115.142263:0:14347:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c1f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3de1064d33a8c1f8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.142269:0:14347:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c1f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3de1064d33a8c1f8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788842115.142276:0:14347:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c1f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3de1064d33a8c1f8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788842115.142282:0:14347:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788842115.142320:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6792fa91-218c-4171-b8ed-40bcd3d71b04:3308:1875736500740736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788842115.142371:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842115.142430:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500740736 00000100:00100000:3.0:1788842115.142437:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500740736 00010000:00010000:3.0:1788842115.142469:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a7c24e200/0x3de1064d33a8c245 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8c23e expref: 18 pid: 14352 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842115.142496:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788842115.142505:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6792fa91-218c-4171-b8ed-40bcd3d71b04+18:3308:x1875736500740736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788842115.142516:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788842115.142535:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a7c24e200/0x3de1064d33a8c245 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8c23e expref: 18 pid: 14352 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842115.142545:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a7c24e200/0x3de1064d33a8c245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8c23e expref: 18 pid: 14352 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842115.142582:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a7c24e200/0x3de1064d33a8c245 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8c23e expref: 18 pid: 14352 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842115.142597:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788842115.142629:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6792fa91-218c-4171-b8ed-40bcd3d71b04+17:3308:x1875736500740736:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842115.142636:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788842115.142664:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6792fa91-218c-4171-b8ed-40bcd3d71b04:3308:1875736500740736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788842115.142993:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842115.143038:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842115.143057:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489213056 00000100:00100000:0.0:1788842115.143062:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489213056 00010000:00010000:0.0:1788842115.143083:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a7c6cdc00/0x3de1064d33a8c4d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef257a expref: 13 pid: 14350 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842115.143096:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489213184 00000100:00100000:0.0:1788842115.143099:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489213184 00010000:00010000:0.0:1788842115.143110:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a7c6cc400/0x3de1064d33a8c49f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2518 expref: 14 pid: 14352 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842115.143121:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:0.0:1788842115.143142:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7680e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+14:2349:x1875736489213056:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788842115.143152:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788842115.143156:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a7c6cdc00/0x3de1064d33a8c4d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef257a expref: 14 pid: 14350 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842115.143166:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a7c6cdc00/0x3de1064d33a8c4d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef257a expref: 14 pid: 14350 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842115.143178:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788842115.143216:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7680e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+14:2349:x1875736489213056:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 82us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842115.143223:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:0.0:1788842115.143268:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:0.0:1788842115.143274:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76805880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+13:2349:x1875736489213184:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788842115.143282:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788842115.143288:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a7c6cc400/0x3de1064d33a8c49f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2518 expref: 13 pid: 14352 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842115.143296:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a7c6cc400/0x3de1064d33a8c49f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2518 expref: 13 pid: 14352 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842115.143306:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788842115.143325:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76805880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+13:2349:x1875736489213184:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 51us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842115.143331:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 7 00010000:00010000:0.0:1788842115.143424:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842115.143985:0:16472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a7c6cdc00/0x3de1064d33a8c4d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef257a expref: 12 pid: 14350 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842115.143999:0:16472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c4b3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1875736500739968:192.168.204.55@tcp:104: 00010000:00010000:3.0:1788842115.144010:0:16472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a7c6cc400/0x3de1064d33a8c49f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2518 expref: 11 pid: 14352 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842115.144019:0:16472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c4b2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1875736500740096:192.168.204.55@tcp:104: 00010000:00010000:3.0:1788842115.144046:0:16472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d3a40030a00/0x3de1064d33a8c501 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.145772:0:14347:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c1f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8c1f8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.145788:0:14347:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788842115.145810:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c1f1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8c1f8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.145837:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.155@tcp lock: ffff8d3a7c78e200/0x3de1064d33a8c1f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3de1064d33a8c1f8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.145857:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842115.145870:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788842115.145872:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788842115.145938:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6792fa91-218c-4171-b8ed-40bcd3d71b04:3309:1875736500740864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788842115.146017:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842115.146129:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500740864 00000100:00100000:1.0:1788842115.146145:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500740864 00010000:00010000:1.0:1788842115.146175:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8c1f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8c1f1 expref: 17 pid: 14351 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842115.146209:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788842115.146216:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76807480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6792fa91-218c-4171-b8ed-40bcd3d71b04+17:3309:x1875736500740864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788842115.146228:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788842115.146232:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8c1f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3de1064d33a8c1f1 expref: 17 pid: 14351 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.146243:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8c1f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3de1064d33a8c1f1 expref: 17 pid: 14351 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.146257:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a60053e00/0x3de1064d33a8c1f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3de1064d33a8c1f1 expref: 17 pid: 14351 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.146275:0:14345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d3a40030a00/0x3de1064d33a8c501 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.146283:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a40030a00/0x3de1064d33a8c501 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.146309:0:14345:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3a40030a00/0x3de1064d33a8c501 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.146315:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3a40030a00/0x3de1064d33a8c501 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.146321:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d3a40030a00/0x3de1064d33a8c501 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.146327:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d3a40030a00/0x3de1064d33a8c501 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.146332:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40030a00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842115.146337:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d3a40030a00/0x3de1064d33a8c501 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.146344:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d3a40030a00/0x3de1064d33a8c501 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.146356:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d3a40030a00/0x3de1064d33a8c501 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842115.146365:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788842115.146403:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76807480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6792fa91-218c-4171-b8ed-40bcd3d71b04+16:3309:x1875736500740864:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842115.146410:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788842115.146447:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6792fa91-218c-4171-b8ed-40bcd3d71b04:3309:1875736500740864:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788842115.146817:0:16472:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d3a40030a00/0x3de1064d33a8c501 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842115.146826:0:16472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d3a40030a00/0x3de1064d33a8c501 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842115.146832:0:16472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3a40030a00/0x3de1064d33a8c501 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842115.587059:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788842115.908673:0:14389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788842116.523620:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842116.523740:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489213312 00000100:00100000:0.0:1788842116.523752:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489213312 00000100:00100000:0.0:1788842116.523817:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 105 00000100:00100000:0.0:1788842116.523827:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fd51e06-eb1a-40f6-8c4f-348236053b9d+11:13773:x1875736489213312:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788842116.523854:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842116.523872:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a77600400/0x3de1064d33a8c508 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef25ab expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842116.523899:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a77600400/0x3de1064d33a8c508 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25ab expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842116.523910:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a77600400/0x3de1064d33a8c508 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25ab expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842116.523920:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a77600400, rc 0) 00000100:00100000:0.0:1788842116.523974:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fd51e06-eb1a-40f6-8c4f-348236053b9d+12:13773:x1875736489213312:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 Request processed in 149us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842116.523982:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 105 00000100:00100000:1.0:1788842116.526410:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842116.526497:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489213440 00000100:00100000:0.0:1788842116.526506:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489213440 00000100:00100000:0.0:1788842116.526551:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 106 00000100:00100000:0.0:1788842116.526561:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+12:13773:x1875736489213440:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788842116.526879:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+12:13773:x1875736489213440:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 Request processed in 319us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842116.526896:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 106 00000100:00100000:0.0:1788842116.532577:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842116.533030:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489213568 00000100:00100000:1.0:1788842116.533042:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489213568 00000100:00100000:1.0:1788842116.533111:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 107 00000100:00100000:1.0:1788842116.533134:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fd51e06-eb1a-40f6-8c4f-348236053b9d+12:13773:x1875736489213568:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788842116.533352:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fd51e06-eb1a-40f6-8c4f-348236053b9d+12:13773:x1875736489213568:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 Request processed in 230us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842116.533361:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 107 00000100:00100000:0.0:1788842116.549310:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842116.549486:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489213696 00000100:00100000:3.0:1788842116.549496:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489213696 00000100:00100000:3.0:1788842116.549554:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 108 00000100:00100000:3.0:1788842116.549565:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fd51e06-eb1a-40f6-8c4f-348236053b9d+12:13773:x1875736489213696:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788842116.549580:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842116.549598:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a40031a00/0x3de1064d33a8c50f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef25b2 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842116.549626:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a40031a00/0x3de1064d33a8c50f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25b2 expref: 13 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842116.549636:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a40031a00/0x3de1064d33a8c50f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25b2 expref: 13 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842116.549646:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40031a00, rc 0) 00000100:00100000:3.0:1788842116.549745:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4fd51e06-eb1a-40f6-8c4f-348236053b9d+13:13773:x1875736489213696:12345-192.168.204.55@tcp:101:ll_cfg_requeue.0 Request processed in 181us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842116.549753:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 108 00000100:00100000:0.0:1788842116.553368:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842116.553501:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489213824 00000100:00100000:2.0:1788842116.553511:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489213824 00000100:00100000:2.0:1788842116.553575:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 109 00000100:00100000:2.0:1788842116.553586:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fd51e06-eb1a-40f6-8c4f-348236053b9d+13:13773:x1875736489213824:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788842116.554351:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fd51e06-eb1a-40f6-8c4f-348236053b9d+13:13773:x1875736489213824:12345-192.168.204.55@tcp:501:ll_cfg_requeue.0 Request processed in 762us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842116.554362:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 109 00000100:00100000:2.0:1788842116.562945:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842116.562980:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489213952 00000100:00100000:2.0:1788842116.562989:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489213952 00000100:00100000:2.0:1788842116.563040:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 110 00000100:00100000:2.0:1788842116.563051:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+13:13773:x1875736489213952:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788842116.563430:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+13:13773:x1875736489213952:12345-192.168.204.55@tcp:503:ll_cfg_requeue.0 Request processed in 379us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842116.563440:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 110 00010000:00010000:3.0:1788842116.609864:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788842116.994937:0:14354:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788842116.994945:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3a76a92800 from 10 10000000:01000000:2.0:1788842116.994949:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788842116.994998:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cde00/0x3de1064d33a8c516 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842116.995009:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cde00/0x3de1064d33a8c516 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842116.995019:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cde00/0x3de1064d33a8c516 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842116.995045:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a49ade300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500740992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788842116.995138:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842116.995195:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a412ed900 going to sleep for 11 seconds 00000100:00100000:3.0:1788842116.995242:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500740992 00000100:00100000:3.0:1788842116.995248:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500740992 00000100:00100000:3.0:1788842116.995299:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788842116.995309:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+16:14354:x1875736500740992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788842116.995322:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842116.995335:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a40030a00/0x3de1064d33a8c51d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8c516 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842116.995383:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a40030a00/0x3de1064d33a8c51d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8c516 expref: 17 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842116.995393:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a40030a00/0x3de1064d33a8c51d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c516 expref: 17 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842116.995402:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40030a00, rc 0) 00000100:00100000:3.0:1788842116.995448:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+17:14354:x1875736500740992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842116.995455:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788842117.001382:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a49ade300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500740992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788842117.001410:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cde00/0x3de1064d33a8c516 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c51d expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842117.001422:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cde00/0x3de1064d33a8c516 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8c51d expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842117.001500:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76806300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500741120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788842117.001565:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842117.001614:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a76036f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788842117.006821:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500741120 00000100:00100000:1.0:1788842117.007213:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500741120 00000100:00100000:1.0:1788842117.008561:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788842117.008576:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+17:14354:x1875736500741120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788842117.008912:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+17:14354:x1875736500741120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 340us (7346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842117.008920:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788842117.009523:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76806300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500741120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788842117.009581:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76806300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500741248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788842117.009626:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842117.013337:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a76036f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788842117.013656:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500741248 00000100:00100000:3.0:1788842117.013665:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500741248 00000100:00100000:3.0:1788842117.013789:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788842117.013798:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+17:14354:x1875736500741248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788842117.014039:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+17:14354:x1875736500741248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 240us (4411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842117.014047:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788842117.016956:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76806300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500741248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788842117.017901:0:16548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788842117.017955:0:14354:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788842117.017974:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788842117.017984:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cde00/0x3de1064d33a8c516 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c51d expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842117.018009:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a7c6cde00/0x3de1064d33a8c516 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c51d expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788842117.018019:0:14354:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788842117.018022:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3a75de4000 from 10 10000000:01000000:0.0:1788842117.018025:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788842117.018569:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a77600000/0x3de1064d33a8c524 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842117.018579:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a77600000/0x3de1064d33a8c524 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842117.018589:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a77600000/0x3de1064d33a8c524 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842117.018612:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76806300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500741376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788842117.018672:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842117.018741:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a76036480 going to sleep for 11 seconds 00000100:00100000:1.0:1788842117.020289:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500741376 00000100:00100000:1.0:1788842117.020302:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500741376 00000100:00100000:1.0:1788842117.020371:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788842117.020382:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+17:14354:x1875736500741376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788842117.020397:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788842117.020415:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c24fe00/0x3de1064d33a8c52b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8c524 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842117.020442:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c24fe00/0x3de1064d33a8c52b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8c524 expref: 18 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842117.020453:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c24fe00/0x3de1064d33a8c52b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c524 expref: 18 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842117.021187:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c24fe00, rc 0) 00000100:00100000:1.0:1788842117.021284:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+18:14354:x1875736500741376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 902us (2608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842117.021292:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788842117.021388:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76806300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500741376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788842117.021409:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a77600000/0x3de1064d33a8c524 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c52b expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842117.021420:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a77600000/0x3de1064d33a8c524 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8c52b expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842117.021571:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c4b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500741504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788842117.021607:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842117.021642:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a793c4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788842117.021794:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500741504 00000100:00100000:1.0:1788842117.021799:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500741504 00000100:00100000:1.0:1788842117.025626:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788842117.025649:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+18:14354:x1875736500741504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788842117.025998:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+18:14354:x1875736500741504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 358us (4389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842117.026006:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788842117.031061:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c4b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500741504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788842117.031646:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c4b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500741632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788842117.031734:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842117.031773:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a793c4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788842117.031796:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500741632 00000100:00100000:3.0:1788842117.031802:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500741632 00000100:00100000:3.0:1788842117.031922:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788842117.031986:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+18:14354:x1875736500741632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788842117.033922:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+18:14354:x1875736500741632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1931us (2178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842117.033936:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788842117.041413:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c4b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500741632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788842117.055055:0:16551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788842117.056319:0:14354:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788842117.056347:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788842117.056360:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a77600000/0x3de1064d33a8c524 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c52b expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842117.056371:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a77600000/0x3de1064d33a8c524 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c52b expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788842117.056381:0:14354:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788842117.056384:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3a4fa2d800 from 10 10000000:01000000:1.0:1788842117.056387:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788842117.056425:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ea00/0x3de1064d33a8c532 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842117.056432:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ea00/0x3de1064d33a8c532 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842117.056452:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ea00/0x3de1064d33a8c532 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842117.058086:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500741760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788842117.058172:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842117.058215:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4353acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788842117.059399:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500741760 00000100:00100000:2.0:1788842117.059408:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500741760 00000100:00100000:2.0:1788842117.059459:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788842117.059481:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+18:14354:x1875736500741760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788842117.059497:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842117.059516:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3a7c6cc600/0x3de1064d33a8c539 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3de1064d33a8c532 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842117.059544:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3a7c6cc600/0x3de1064d33a8c539 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3de1064d33a8c532 expref: 19 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842117.059554:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3a7c6cc600/0x3de1064d33a8c539 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3de1064d33a8c532 expref: 19 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842117.059563:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cc600, rc 0) 00000100:00100000:2.0:1788842117.059619:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:14354:x1875736500741760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842117.059626:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788842117.060103:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500741760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788842117.060121:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ea00/0x3de1064d33a8c532 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c539 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842117.060131:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ea00/0x3de1064d33a8c532 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3de1064d33a8c539 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842117.060202:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500741888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788842117.060237:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788842117.060262:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4353acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788842117.060378:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500741888 00000100:00100000:2.0:1788842117.060383:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500741888 00000100:00100000:2.0:1788842117.060420:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788842117.060428:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:14354:x1875736500741888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788842117.060702:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:14354:x1875736500741888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 274us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842117.060736:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788842117.061067:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500741888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788842117.061120:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c4b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500742016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788842117.061162:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842117.061184:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a793c46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788842117.062278:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500742016 00000100:00100000:1.0:1788842117.062286:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500742016 00000100:00100000:1.0:1788842117.062338:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788842117.062347:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a48e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:14354:x1875736500742016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788842117.062540:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a48e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:14354:x1875736500742016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (1377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842117.062548:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788842117.063044:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c4b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6792fa91-218c-4171-b8ed-40bcd3d71b04:14354:1875736500742016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788842117.063692:0:16552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788842117.063765:0:14354:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788842117.063783:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788842117.063793:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ea00/0x3de1064d33a8c532 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c539 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842117.063803:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.155@tcp lock: ffff8d3a7c24ea00/0x3de1064d33a8c532 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3de1064d33a8c539 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842117.555321:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842117.555883:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842117.555911:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842117.555921:0:16010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489214464 00000100:00100000:0.0:1788842117.555937:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842117.555942:0:16010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489214464 00000100:00100000:0.0:1788842117.555959:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842117.555977:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489214720 00000100:00100000:0.0:1788842117.555981:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489214720 00000100:00100000:2.0:1788842117.555996:0:16010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489214336 00000100:00100000:2.0:1788842117.555998:0:16010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489214336 00000100:00100000:0.0:1788842117.556002:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:0.0:1788842117.556010:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+5:2350:x1875736489214464:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788842117.556013:0:16010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:2.0:1788842117.556019:0:16010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36a793d4-b9b8-4df6-a0a0-b45d7f854203+5:2350:x1875736489214720:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788842117.556082:0:16010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36a793d4-b9b8-4df6-a0a0-b45d7f854203+5:2350:x1875736489214720:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 63us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842117.556089:0:16010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:2.0:1788842117.556105:0:16010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 14 00000100:00100000:2.0:1788842117.556111:0:16010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+5:2350:x1875736489214336:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:1.0:1788842117.561790:0:16232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489214208 00000100:00100000:1.0:1788842117.561808:0:16232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489214208 00000100:00100000:1.0:1788842117.561898:0:16232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 22 00000100:00100000:1.0:1788842117.561920:0:16232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+6:2350:x1875736489214208:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788842117.568177:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+5:2350:x1875736489214464:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 12155us (12284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842117.568198:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:0.0:1788842117.568250:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489214080 00000100:00100000:0.0:1788842117.568259:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489214080 00000100:00100000:0.0:1788842117.568306:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 120 00000100:00100000:0.0:1788842117.568314:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7d87c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fd51e06-eb1a-40f6-8c4f-348236053b9d+13:2350:x1875736489214080:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788842117.568356:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7d87c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4fd51e06-eb1a-40f6-8c4f-348236053b9d+13:2350:x1875736489214080:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 44us (12419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842117.568362:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 120 00000100:00100000:0.0:1788842117.568459:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842117.568526:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842117.568624:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489214848 00000100:00100000:0.0:1788842117.568628:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489214848 00000100:00100000:0.0:1788842117.568656:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00100000:0.0:1788842117.568662:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36a793d4-b9b8-4df6-a0a0-b45d7f854203+5:2350:x1875736489214848:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788842117.568694:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:36a793d4-b9b8-4df6-a0a0-b45d7f854203+5:2350:x1875736489214848:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 32us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842117.568699:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00080000:0.0:1788842117.568731:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788842117.568737:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788842117.568739:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788842117.568747:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489214592 00000100:00100000:0.0:1788842117.568751:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489214592 00000100:00100000:0.0:1788842117.568780:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 23 00000100:00100000:0.0:1788842117.568787:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36a793d4-b9b8-4df6-a0a0-b45d7f854203+6:2350:x1875736489214592:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:0.0:1788842117.568823:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36a793d4-b9b8-4df6-a0a0-b45d7f854203+6:2350:x1875736489214592:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 26us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842117.568837:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 23 00000100:00080000:0.0:1788842117.568879:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788842117.571034:0:16010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+5:2350:x1875736489214336:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 14909us (15060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842117.571050:0:16010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 14 00000100:00100000:2.0:1788842117.572062:0:16232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+6:2350:x1875736489214208:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 10142us (16745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842117.572074:0:16232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 22 00010000:00010000:0.0:1788842117.636744:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788842118.660427:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788842119.278760:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842119.285846:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489214976 00000100:00100000:3.0:1788842119.285864:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489214976 00000100:00100000:3.0:1788842119.286045:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00100000:3.0:1788842119.286068:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a76806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+6:14431:x1875736489214976:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788842119.286089:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842119.286113:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c540 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef25b9 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.286196:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031800/0x3de1064d33a8c547 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.286211:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031800/0x3de1064d33a8c547 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.286225:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031800/0x3de1064d33a8c547 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.286239:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031e00/0x3de1064d33a8c54e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.286246:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031e00/0x3de1064d33a8c54e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.286253:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031e00/0x3de1064d33a8c54e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.286600:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030800/0x3de1064d33a8c555 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.286620:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030800/0x3de1064d33a8c555 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.286627:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030800/0x3de1064d33a8c555 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788842119.286652:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788842119.286655:0:14359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788842119.286688:0:14359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030800/0x3de1064d33a8c555 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.286700:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031800/0x3de1064d33a8c547 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.286707:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031800/0x3de1064d33a8c547 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.286738:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031800/0x3de1064d33a8c547 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.286744:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40031800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842119.286748:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031800/0x3de1064d33a8c547 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.286754:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031800/0x3de1064d33a8c547 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.286766:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a61283200) 00010000:00010000:3.0:1788842119.286769:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788842119.286775:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031800/0x3de1064d33a8c547 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.286803:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031800/0x3de1064d33a8c547 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.286817:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031e00/0x3de1064d33a8c54e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.286823:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031e00/0x3de1064d33a8c54e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.286829:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031e00/0x3de1064d33a8c54e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.286834:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40031e00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842119.286838:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031e00/0x3de1064d33a8c54e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.286844:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031e00/0x3de1064d33a8c54e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.286853:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d3a42af4f00) 00010000:00010000:3.0:1788842119.286856:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788842119.286859:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031e00/0x3de1064d33a8c54e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.286865:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031e00/0x3de1064d33a8c54e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.286896:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c540 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25b9 expref: 8 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.286923:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030800/0x3de1064d33a8c555 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25b9 expref: 7 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.286931:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d3a42af4200) 00010000:00010000:3.0:1788842119.286933:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788842119.286935:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40030800, rc 0) 00000100:00100000:3.0:1788842119.287014:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a76806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+7:14431:x1875736489214976:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 959us (8263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842119.287023:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00080000:0.0:1788842119.288529:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788842119.298165:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6792fa91-218c-4171-b8ed-40bcd3d71b04:3310:1875736500742144:0@lo:400:kworker.0 00000100:00100000:0.0:1788842119.298241:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842119.298293:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875736500742656:0@lo:400:kworker.0 00000100:00100000:0.0:1788842119.298321:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842119.298347:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788842119.298354:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875736500742528:0@lo:400:kworker.0 00000100:00100000:0.0:1788842119.298385:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842119.298417:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500742272:0@lo:400:kworker.0 00000100:00100000:1.0:1788842119.298445:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500742400:0@lo:400:kworker.0 00000100:00100000:0.0:1788842119.298451:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842119.298476:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875736500742784:0@lo:400:kworker.0 00000100:00100000:1.0:1788842119.298487:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842119.299058:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500742144 00000100:00100000:2.0:1788842119.299068:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500742144 00000100:00100000:2.0:1788842119.299117:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788842119.299128:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7d87e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:3310:x1875736500742144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788842119.303133:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842119.303201:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500742656 00000100:00100000:0.0:1788842119.303211:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500742656 00000100:00100000:0.0:1788842119.303262:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500742528 00000100:00100000:0.0:1788842119.303265:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500742528 00000100:00100000:0.0:1788842119.303280:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500742784 00000100:00100000:0.0:1788842119.303282:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500742784 00000100:00100000:0.0:1788842119.303311:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788842119.303321:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875736500742656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788842119.303376:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875736500742656:12345-0@lo:400:kworker.0 Request processed in 57us (5054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842119.303399:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788842119.303416:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788842119.303422:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875736500742528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788842119.303465:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875736500742528:12345-0@lo:400:kworker.0 Request processed in 44us (5080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842119.303470:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788842119.303482:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788842119.303488:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875736500742784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788842119.303518:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875736500742784:12345-0@lo:400:kworker.0 Request processed in 31us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842119.303523:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788842119.303542:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500742272 00000100:00100000:0.0:1788842119.303546:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500742272 00000100:00100000:0.0:1788842119.303571:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500742400 00000100:00100000:0.0:1788842119.303574:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500742400 00000100:00100000:0.0:1788842119.303594:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788842119.303600:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500742272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788842119.303632:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875736500742272:12345-0@lo:400:kworker.0 Request processed in 32us (5183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842119.303637:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788842119.303647:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788842119.303653:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500742400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788842119.303680:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500742400:12345-0@lo:400:kworker.0 Request processed in 28us (5195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842119.303686:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788842119.303731:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788842119.303736:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788842119.303738:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788842119.303770:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875736500742528:0@lo:400:kworker.0 00000100:00100000:0.0:1788842119.303800:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875736500742656:0@lo:400:kworker.0 00000100:00100000:0.0:1788842119.303847:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875736500742272:0@lo:400:kworker.0 00000100:00100000:0.0:1788842119.303858:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875736500742784:0@lo:400:kworker.0 00000100:00100000:1.0:1788842119.304605:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500742400:0@lo:400:kworker.0 00000100:00100000:1.0:1788842119.304619:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a761bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500742912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788842119.304673:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842119.310204:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500742912 00000100:00100000:0.0:1788842119.310219:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500742912 00000100:00100000:0.0:1788842119.310291:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788842119.310303:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500742912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788842119.310343:0:15046:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788842119.310445:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500742912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (5771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842119.310454:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788842119.310521:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a761bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500742912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788842119.313650:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7d87e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:3310:x1875736500742144:12345-0@lo:400:kworker.0 Request processed in 14516us (15400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842119.313675:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788842119.313864:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6792fa91-218c-4171-b8ed-40bcd3d71b04:3310:1875736500742144:0@lo:400:kworker.0 00000100:00100000:3.0:1788842119.315088:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842119.315252:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489215232 00000100:00100000:0.0:1788842119.315262:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489215232 00000100:00100000:0.0:1788842119.315444:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:0.0:1788842119.315454:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+7:14431:x1875736489215232:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788842119.315491:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842119.315514:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600e00/0x3de1064d33a8c55c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef25c0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.315608:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600200/0x3de1064d33a8c563 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.315623:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600200/0x3de1064d33a8c563 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.315635:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600200/0x3de1064d33a8c563 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.315682:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c56a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.315690:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c56a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.315697:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c56a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.316058:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601e00/0x3de1064d33a8c571 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.316068:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601e00/0x3de1064d33a8c571 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.316149:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601e00/0x3de1064d33a8c571 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788842119.316160:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788842119.316432:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600200/0x3de1064d33a8c563 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.316450:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600200/0x3de1064d33a8c563 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.316456:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600200/0x3de1064d33a8c563 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.316462:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a77600200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842119.316467:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600200/0x3de1064d33a8c563 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.316474:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600200/0x3de1064d33a8c563 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.316488:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d3a42af4200) 00010000:00010000:0.0:1788842119.316491:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842119.316495:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600200/0x3de1064d33a8c563 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.316501:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600200/0x3de1064d33a8c563 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.316513:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c56a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.316519:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c56a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.316524:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c56a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.316528:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a77601400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842119.316538:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c56a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.316543:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c56a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.316551:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d3a4e719b00) 00010000:00010000:0.0:1788842119.316553:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842119.316556:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c56a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.316561:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c56a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.317976:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600e00/0x3de1064d33a8c55c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25c0 expref: 10 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.318000:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601e00/0x3de1064d33a8c571 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25c0 expref: 9 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.318010:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d3a4e719d00) 00010000:00010000:0.0:1788842119.318013:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842119.318016:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a77601e00, rc 0) 00000100:00100000:0.0:1788842119.318225:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+9:14431:x1875736489215232:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 2771us (3141us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788842119.318235:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:2.0:1788842119.339432:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842119.339536:0:16232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489215360 00000100:00100000:0.0:1788842119.339547:0:16232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489215360 00000100:00100000:0.0:1788842119.339613:0:16232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:0.0:1788842119.339623:0:16232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+9:14431:x1875736489215360:12345-192.168.204.55@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788842119.339807:0:16232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+9:14431:x1875736489215360:12345-192.168.204.55@tcp:59:lhsmtool_posix.0 Request processed in 184us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842119.339815:0:16232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:2.0:1788842119.376347:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842119.376654:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489215488 00000100:00100000:1.0:1788842119.376665:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489215488 00000100:00100000:1.0:1788842119.376823:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 18 00000100:00100000:1.0:1788842119.376834:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+9:14437:x1875736489215488:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1788842119.376854:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788842119.376878:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e000/0x3de1064d33a8c57f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef25c7 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.376948:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c586 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.376964:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c586 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.376976:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c586 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.376992:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e800/0x3de1064d33a8c58d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.376998:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e800/0x3de1064d33a8c58d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.377020:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e800/0x3de1064d33a8c58d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.377209:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c586 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.377217:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c586 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.377222:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c586 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.377228:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24f400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788842119.377232:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c586 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.377239:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c586 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.377251:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a61283200) 00010000:00010000:1.0:1788842119.377253:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788842119.377257:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c586 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.377263:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c586 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.377388:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e800/0x3de1064d33a8c58d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.377395:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e800/0x3de1064d33a8c58d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.377409:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e800/0x3de1064d33a8c58d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.377414:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24e800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788842119.377417:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e800/0x3de1064d33a8c58d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.377422:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e800/0x3de1064d33a8c58d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.377430:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d3a428dfc00) 00010000:00010000:1.0:1788842119.377433:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788842119.377436:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e800/0x3de1064d33a8c58d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.377441:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e800/0x3de1064d33a8c58d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.377471:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e000/0x3de1064d33a8c57f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25c7 expref: 10 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.377653:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a61283200) 00010000:00010000:1.0:1788842119.377656:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788842119.377660:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e000/0x3de1064d33a8c57f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25c7 expref: 10 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.377671:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c24e000, rc 0) 00000100:00100000:1.0:1788842119.378031:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+9:14437:x1875736489215488:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 1198us (1693us total) trans 0 rc 301/301 00000100:00100000:1.0:1788842119.378050:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 18 00000100:00100000:1.0:1788842119.383364:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842119.383563:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489215616 00000100:00100000:3.0:1788842119.383574:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489215616 00000100:00100000:3.0:1788842119.383636:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:3.0:1788842119.383648:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:10bbae73-32ed-4506-b337-b06c2cb26bae+9:14437:x1875736489215616:12345-192.168.204.55@tcp:700:lfs.0 00000100:00100000:3.0:1788842119.390687:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:10bbae73-32ed-4506-b337-b06c2cb26bae+9:14437:x1875736489215616:12345-192.168.204.55@tcp:700:lfs.0 Request processed in 7023us (7314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842119.390703:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:2.0:1788842119.395322:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842119.396435:0:16232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489215872 00000100:00100000:0.0:1788842119.396447:0:16232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489215872 00000100:00100000:0.0:1788842119.396554:0:16232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 19 00000100:00100000:0.0:1788842119.396566:0:16232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+9:14437:x1875736489215872:12345-192.168.204.55@tcp:36:lfs.0 00010000:00010000:0.0:1788842119.396624:0:16232:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788842119.396653:0:16232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c4c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2542 expref: 9 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.396672:0:16232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a61283200) 00010000:00010000:0.0:1788842119.396688:0:16232:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788842119.396982:0:16232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c594 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.396996:0:16232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030400/0x3de1064d33a8c4fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25a4 expref: 5 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.397004:0:16232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c594 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.397037:0:16232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030400/0x3de1064d33a8c4fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25a4 expref: 5 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.397051:0:16232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030400/0x3de1064d33a8c4fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25a4 expref: 5 pid: 14360 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842119.397081:0:16232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7c5d0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16232:1875736500743040:192.168.204.55@tcp:104: 00000100:00100000:0.0:1788842119.397606:0:16232:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a76036a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788842119.404180:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842119.404255:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489216000 00000100:00100000:1.0:1788842119.404265:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489216000 00010000:00010000:1.0:1788842119.404335:0:14343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030400/0x3de1064d33a8c4fa lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25a4 expref: 6 pid: 14360 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842119.404375:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:1.0:1788842119.404385:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49add500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36a793d4-b9b8-4df6-a0a0-b45d7f854203+6:2350:x1875736489216000:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788842119.404401:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788842119.404408:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030400/0x3de1064d33a8c4fa lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25a4 expref: 6 pid: 14360 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.404420:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030400/0x3de1064d33a8c4fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25a4 expref: 6 pid: 14360 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.404443:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a61283200) 00010000:00010000:1.0:1788842119.404448:0:14343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c594 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.404457:0:14343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c594 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.404464:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c594 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.404493:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788842119.404548:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49add500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36a793d4-b9b8-4df6-a0a0-b45d7f854203+6:2350:x1875736489216000:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 164us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842119.404570:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00080000:2.0:1788842119.404632:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788842119.405199:0:16232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40030400/0x3de1064d33a8c4fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25a4 expref: 5 pid: 14360 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842119.405217:0:16232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7c5d0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16232:1875736500743040:192.168.204.55@tcp:104: 00010000:00010000:0.0:1788842119.405239:0:16232:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c594 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.405248:0:16232:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c594 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.405254:0:16232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c594 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.405337:0:16232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600200/0x3de1064d33a8c59b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.405349:0:16232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600200/0x3de1064d33a8c59b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.405358:0:16232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600200/0x3de1064d33a8c59b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788842119.407616:0:16232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788842119.407633:0:16232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c594 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.407642:0:16232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c594 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.407654:0:16232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c594 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.407660:0:16232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a77601400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842119.407664:0:16232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c594 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.407682:0:16232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c594 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.407698:0:16232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a61283200) 00010000:00010000:0.0:1788842119.407701:0:16232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842119.407706:0:16232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c594 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.407764:0:16232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c594 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788842119.407796:0:16232:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001de07bae reply state 00000000c30bab73 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600200/0x3de1064d33a8c59b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842119.407805:0:16232:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788842119.407895:0:16232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+10:14437:x1875736489215872:12345-192.168.204.55@tcp:36:lfs.0 Request processed in 11329us (12580us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788842119.408611:0:16232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 19 00010000:00010000:1.0:1788842119.411421:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600200/0x3de1064d33a8c59b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.411438:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600200/0x3de1064d33a8c59b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.411446:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600200/0x3de1064d33a8c59b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.411453:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a77600200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788842119.411464:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600200/0x3de1064d33a8c59b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.411474:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600200/0x3de1064d33a8c59b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.411497:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d3a4e719b00) 00010000:00010000:1.0:1788842119.411500:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788842119.411504:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600200/0x3de1064d33a8c59b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.411509:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600200/0x3de1064d33a8c59b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842119.535949:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842119.536075:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489216128 00000100:00100000:1.0:1788842119.536088:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489216128 00000100:00100000:1.0:1788842119.536155:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 20 00000100:00100000:1.0:1788842119.536165:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+9:14445:x1875736489216128:12345-192.168.204.55@tcp:101:lctl.0 00010000:00010000:1.0:1788842119.536189:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788842119.536224:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c5a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef25ce expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.536297:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e200/0x3de1064d33a8c5a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.536311:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e200/0x3de1064d33a8c5a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.536322:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e200/0x3de1064d33a8c5a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788842119.536369:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788842119.536373:0:14357:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788842119.536412:0:14357:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e200/0x3de1064d33a8c5a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.536436:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c5a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25ce expref: 11 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.536454:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e200/0x3de1064d33a8c5a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25ce expref: 10 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.536462:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a428dfc00) 00010000:00010000:1.0:1788842119.536465:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788842119.536468:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c24e200, rc 0) 00000100:00100000:1.0:1788842119.536523:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+10:14445:x1875736489216128:12345-192.168.204.55@tcp:101:lctl.0 Request processed in 359us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842119.536530:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 20 00000100:00100000:2.0:1788842119.559358:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842119.559479:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489216256 00000100:00100000:3.0:1788842119.559492:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489216256 00000100:00100000:3.0:1788842119.559589:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00100000:3.0:1788842119.559602:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36a793d4-b9b8-4df6-a0a0-b45d7f854203+5:14446:x1875736489216256:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1788842119.559629:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842119.559657:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c5b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef25d5 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.559829:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031e00/0x3de1064d33a8c5b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.559849:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031e00/0x3de1064d33a8c5b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.559863:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031e00/0x3de1064d33a8c5b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788842119.559912:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788842119.559915:0:14359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788842119.559942:0:14359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031e00/0x3de1064d33a8c5b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.559972:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c5b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25d5 expref: 7 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.559996:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031e00/0x3de1064d33a8c5b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25d5 expref: 6 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.560006:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a428dfc00) 00010000:00010000:3.0:1788842119.560009:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788842119.560013:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40031e00, rc 0) 00000100:00100000:3.0:1788842119.560337:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36a793d4-b9b8-4df6-a0a0-b45d7f854203+6:14446:x1875736489216256:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 735us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842119.560346:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00100000:3.0:1788842119.566755:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842119.567644:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489216384 00000100:00100000:1.0:1788842119.567689:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489216384 00000100:00100000:1.0:1788842119.567821:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 22 00000100:00100000:1.0:1788842119.567834:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36a793d4-b9b8-4df6-a0a0-b45d7f854203+6:14446:x1875736489216384:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:1.0:1788842119.567853:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788842119.567874:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c5be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef25dc expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.567947:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8c5c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.567962:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8c5c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.567974:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8c5c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.567988:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8c5cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.567994:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8c5cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.568000:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8c5cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.568156:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f800/0x3de1064d33a8c5d3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.568165:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f800/0x3de1064d33a8c5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.568171:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f800/0x3de1064d33a8c5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788842119.568207:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788842119.568211:0:14357:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788842119.568233:0:14357:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f800/0x3de1064d33a8c5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.568245:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8c5c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.568252:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8c5c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.568258:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8c5c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.568264:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24f200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788842119.568268:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8c5c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.568275:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8c5c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.568288:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a428dfc00) 00010000:00010000:1.0:1788842119.568291:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788842119.568295:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8c5c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.568301:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8c5c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.568314:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8c5cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.568328:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8c5cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.568334:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8c5cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.568339:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24e600 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788842119.568342:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8c5cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.568348:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8c5cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.568355:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d3a428df300) 00010000:00010000:1.0:1788842119.568357:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788842119.568360:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8c5cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.568365:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8c5cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.568395:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c5be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25dc expref: 8 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.568407:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f800/0x3de1064d33a8c5d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25dc expref: 7 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.568414:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d3a428df900) 00010000:00010000:1.0:1788842119.568417:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788842119.568426:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c24f800, rc 0) 00000100:00100000:1.0:1788842119.568498:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36a793d4-b9b8-4df6-a0a0-b45d7f854203+7:14446:x1875736489216384:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 667us (1760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842119.568505:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 22 00000100:00100000:2.0:1788842119.572637:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842119.572954:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489216640 00000100:00100000:3.0:1788842119.572979:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489216640 00000100:00100000:3.0:1788842119.573050:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 23 00000100:00100000:3.0:1788842119.573061:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a49adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36a793d4-b9b8-4df6-a0a0-b45d7f854203+7:14446:x1875736489216640:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:3.0:1788842119.573081:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842119.573103:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c5da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef25e3 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788842119.573198:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788842119.573335:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c5da lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25e3 expref: 9 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.573351:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a428dfc00) 00010000:00010000:3.0:1788842119.573354:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788842119.573360:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c5da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25e3 expref: 9 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.573376:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40031600, rc 0) 00000100:00100000:3.0:1788842119.573687:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a49adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36a793d4-b9b8-4df6-a0a0-b45d7f854203+8:14446:x1875736489216640:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 625us (1058us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788842119.573695:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 23 00000100:00100000:2.0:1788842119.579494:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842119.579657:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489216896 00000100:00100000:0.0:1788842119.579678:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489216896 00000100:00100000:0.0:1788842119.579772:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 24 00000100:00100000:0.0:1788842119.580137:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a793d4-b9b8-4df6-a0a0-b45d7f854203+8:14446:x1875736489216896:12345-192.168.204.55@tcp:36:lfs.0 00010000:00010000:0.0:1788842119.580213:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788842119.580244:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f800/0x3de1064d33a8c5d3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25dc expref: 8 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.580263:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d3a428df900) 00010000:00010000:0.0:1788842119.580274:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788842119.580300:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c5e8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.580313:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c5e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.580322:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c5e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788842119.580540:0:14360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad7381ac reply state 00000000be530fd2 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c5e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842119.580549:0:14360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788842119.580556:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788842119.580901:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a793d4-b9b8-4df6-a0a0-b45d7f854203+9:14446:x1875736489216896:12345-192.168.204.55@tcp:36:lfs.0 Request processed in 574us (1222us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788842119.580910:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 24 00000100:00100000:1.0:1788842119.586967:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842119.587053:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489217152 00000100:00100000:0.0:1788842119.587064:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489217152 00000100:00100000:0.0:1788842119.587123:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 2 00000100:00100000:0.0:1788842119.587134:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36a793d4-b9b8-4df6-a0a0-b45d7f854203+9:14446:x1875736489217152:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:0.0:1788842119.587381:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36a793d4-b9b8-4df6-a0a0-b45d7f854203+10:14446:x1875736489217152:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 248us (422us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788842119.587406:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 2 00010000:00010000:1.0:1788842119.587845:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c5e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.587862:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c5e8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.587871:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c5e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.587879:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a77601400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:1.0:1788842119.587883:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c5e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.587891:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c5e8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.587909:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d3a4e719f00) 00010000:00010000:1.0:1788842119.587913:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788842119.587918:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c5e8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842119.587925:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601400/0x3de1064d33a8c5e8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842119.596733:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842119.597977:0:16232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489217408 00000100:00100000:2.0:1788842119.597990:0:16232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489217408 00000100:00100000:2.0:1788842119.598062:0:16232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 25 00000100:00100000:2.0:1788842119.598073:0:16232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36a793d4-b9b8-4df6-a0a0-b45d7f854203+9:14446:x1875736489217408:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1788842119.598097:0:16232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842119.598118:0:16232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8c5ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef25ea expref: -99 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.598194:0:16232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c5f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.598208:0:16232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c5f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.598220:0:16232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c5f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.598234:0:16232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8c5fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.598240:0:16232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8c5fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.598246:0:16232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8c5fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788842119.598368:0:16232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788842119.598456:0:16232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c5f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.598464:0:16232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c5f6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.598469:0:16232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c5f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.598475:0:16232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842119.598480:0:16232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c5f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.598487:0:16232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c5f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.598499:0:16232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a428dfc00) 00010000:00010000:2.0:1788842119.598503:0:16232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842119.598507:0:16232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c5f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.598513:0:16232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c5f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.598528:0:16232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8c5fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.598533:0:16232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8c5fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.598549:0:16232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8c5fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.598554:0:16232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cdc00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842119.598556:0:16232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8c5fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.598562:0:16232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8c5fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.598570:0:16232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d3a61283a00) 00010000:00010000:2.0:1788842119.598572:0:16232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842119.598575:0:16232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8c5fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.598579:0:16232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8c5fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.598621:0:16232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8c5ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25ea expref: 11 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.598631:0:16232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a428dfc00) 00010000:00010000:2.0:1788842119.598633:0:16232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788842119.598636:0:16232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8c5ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25ea expref: 11 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.598645:0:16232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cc000, rc 0) 00000100:00100000:2.0:1788842119.601270:0:16232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36a793d4-b9b8-4df6-a0a0-b45d7f854203+10:14446:x1875736489217408:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 3186us (4559us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788842119.601307:0:16232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 25 00000100:00100000:0.0:1788842119.619788:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842119.619962:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489217536 00000100:00100000:2.0:1788842119.619974:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489217536 00000100:00100000:2.0:1788842119.620033:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 26 00000100:00100000:2.0:1788842119.620044:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a793d4-b9b8-4df6-a0a0-b45d7f854203+10:14446:x1875736489217536:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1788842119.620069:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842119.620092:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8c60b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef25f1 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.620179:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8c612 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.620194:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8c612 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.620207:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8c612 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788842119.620233:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788842119.620236:0:14360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788842119.620253:0:14360:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8c612 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.620278:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8c60b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25f1 expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.620298:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8c612 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25f1 expref: 11 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.620326:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d3a61283a00) 00010000:00010000:2.0:1788842119.620329:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788842119.620333:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cdc00, rc 0) 00000100:00100000:2.0:1788842119.620399:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a793d4-b9b8-4df6-a0a0-b45d7f854203+11:14446:x1875736489217536:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 357us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842119.620406:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 26 00000100:00100000:3.0:1788842119.623518:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842119.623633:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489217664 00000100:00100000:0.0:1788842119.623646:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489217664 00000100:00100000:0.0:1788842119.623762:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 3 00000100:00100000:0.0:1788842119.623786:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36a793d4-b9b8-4df6-a0a0-b45d7f854203+11:14446:x1875736489217664:12345-192.168.204.55@tcp:37:lfs.0 00000100:00100000:0.0:1788842119.630649:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:36a793d4-b9b8-4df6-a0a0-b45d7f854203+11:14446:x1875736489217664:12345-192.168.204.55@tcp:37:lfs.0 Request processed in 6864us (7128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842119.630666:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 3 00000100:00100000:0.0:1788842119.660208:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842119.663748:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489217920 00000100:00100000:2.0:1788842119.663765:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489217920 00000100:00100000:2.0:1788842119.663841:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 4 00000100:00100000:2.0:1788842119.663851:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75dc0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36a793d4-b9b8-4df6-a0a0-b45d7f854203+11:14446:x1875736489217920:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:2.0:1788842119.664125:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75dc0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36a793d4-b9b8-4df6-a0a0-b45d7f854203+12:14446:x1875736489217920:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 274us (3925us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788842119.664132:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 4 00010000:00010000:0.0:1788842119.683375:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788842119.751637:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842119.753484:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489218048 00000100:00100000:0.0:1788842119.753501:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489218048 00000100:00100000:0.0:1788842119.753601:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 27 00000100:00100000:0.0:1788842119.753613:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+10:14452:x1875736489218048:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:0.0:1788842119.753638:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842119.753663:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601800/0x3de1064d33a8c619 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef25f8 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.753796:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600800/0x3de1064d33a8c620 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.753811:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600800/0x3de1064d33a8c620 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.753822:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600800/0x3de1064d33a8c620 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.753857:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c627 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.753865:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c627 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.753871:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c627 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.753969:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600c00/0x3de1064d33a8c62e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.753979:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600c00/0x3de1064d33a8c62e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.753986:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600c00/0x3de1064d33a8c62e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788842119.754014:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788842119.754017:0:14359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788842119.754052:0:14359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600c00/0x3de1064d33a8c62e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.754065:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600800/0x3de1064d33a8c620 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.754072:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600800/0x3de1064d33a8c620 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.754078:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600800/0x3de1064d33a8c620 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.754095:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a77600800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842119.754100:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600800/0x3de1064d33a8c620 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.754107:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600800/0x3de1064d33a8c620 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.754121:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a428dfc00) 00010000:00010000:0.0:1788842119.754124:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842119.754129:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600800/0x3de1064d33a8c620 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.754136:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600800/0x3de1064d33a8c620 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.754150:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c627 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.754157:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c627 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.754162:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c627 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.754166:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a77601000 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842119.754169:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c627 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.754175:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c627 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.754193:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d3a4e719700) 00010000:00010000:0.0:1788842119.754196:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842119.754199:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c627 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.754205:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c627 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.754238:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601800/0x3de1064d33a8c619 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25f8 expref: 12 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.754252:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600c00/0x3de1064d33a8c62e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25f8 expref: 11 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.754259:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d3a61283a00) 00010000:00010000:0.0:1788842119.754261:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788842119.754263:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a77600c00, rc 0) 00000100:00100000:0.0:1788842119.754360:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+11:14452:x1875736489218048:12345-192.168.204.55@tcp:101:bash.0 Request processed in 748us (2742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842119.754367:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 27 00000100:00100000:3.0:1788842119.758694:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842119.759136:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489218304 00000100:00100000:2.0:1788842119.759151:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489218304 00000100:00100000:2.0:1788842119.759212:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 28 00000100:00100000:2.0:1788842119.759222:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+11:14452:x1875736489218304:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:2.0:1788842119.759244:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842119.759278:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8c635 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef25ff expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.759408:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c63c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.759423:0:14360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8c612 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25f1 expref: 11 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.759447:0:14360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c63c lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.759483:0:14360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8c612 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25f1 expref: 11 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.759497:0:14360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8c612 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25f1 expref: 11 pid: 14360 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842119.759510:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14360:1875736500743168:192.168.204.55@tcp:104: 00000100:00100000:2.0:1788842119.759618:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a682b9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788842119.764307:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14360:1875736500743168:192.168.204.55@tcp:104: 00010000:00010000:2.0:1788842119.764352:0:14360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c63c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842119.766397:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842119.769254:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489218432 00000100:00100000:0.0:1788842119.769276:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489218432 00010000:00010000:0.0:1788842119.769354:0:14344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8c612 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25f1 expref: 12 pid: 14360 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842119.769400:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:0.0:1788842119.769413:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36a793d4-b9b8-4df6-a0a0-b45d7f854203+12:2349:x1875736489218432:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788842119.769911:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788842119.769922:0:14344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8c612 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25f1 expref: 12 pid: 14360 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.769939:0:14344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8c612 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25f1 expref: 12 pid: 14360 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.769968:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cdc00/0x3de1064d33a8c612 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25f1 expref: 12 pid: 14360 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.769995:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d3a61283a00) 00010000:00010000:0.0:1788842119.770001:0:14344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c63c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.770013:0:14344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c63c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.770022:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c63c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.771476:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788842119.771603:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36a793d4-b9b8-4df6-a0a0-b45d7f854203+11:2349:x1875736489218432:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 2183us (5211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842119.771617:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 10 00010000:00010000:2.0:1788842119.772058:0:14360:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c63c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.772072:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c63c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.772512:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c643 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.772540:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c643 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.772555:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c643 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.773506:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8c64a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.773519:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8c64a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.773526:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8c64a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788842119.773537:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788842119.773565:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c63c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.773571:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c63c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.773577:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c63c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.773583:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842119.773587:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c63c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.773595:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c63c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.773619:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d3a61283a00) 00010000:00010000:2.0:1788842119.773622:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842119.773627:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c63c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.773643:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c63c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788842119.773661:0:14360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6a4122d reply state 000000007659e7f2 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c643 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842119.773670:0:14360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788842119.773745:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8c635 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25ff expref: 14 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.773761:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8c64a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25ff expref: 13 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.773777:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3a61283600) 00010000:00010000:2.0:1788842119.773780:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788842119.773782:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cc400, rc 0) 00000100:00100000:2.0:1788842119.773864:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+14:14452:x1875736489218304:12345-192.168.204.55@tcp:101:bash.0 Request processed in 14642us (15185us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788842119.773874:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 28 00010000:00010000:0.0:1788842119.781185:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c643 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.781211:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c643 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.781246:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c643 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.781254:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd200 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842119.781260:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c643 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.781269:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c643 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.781293:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d3a61283400) 00010000:00010000:0.0:1788842119.781297:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788842119.781302:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c643 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.781309:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd200/0x3de1064d33a8c643 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842119.790640:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842119.791085:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489218560 00000100:00100000:0.0:1788842119.791096:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489218560 00000100:00100000:0.0:1788842119.791160:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 29 00000100:00100000:0.0:1788842119.791171:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+13:14452:x1875736489218560:12345-192.168.204.55@tcp:101:bash.0 00010000:00010000:0.0:1788842119.791197:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842119.791220:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601800/0x3de1064d33a8c658 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2606 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.791286:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c65f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.791318:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c65f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.791329:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c65f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788842119.791370:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788842119.791375:0:14359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788842119.791395:0:14359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c65f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.791405:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c65f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.791429:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601800/0x3de1064d33a8c658 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2606 expref: 15 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.791448:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c65f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2606 expref: 14 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.791456:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3a61283600) 00010000:00010000:0.0:1788842119.791459:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788842119.791463:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a77601000, rc 0) 00000100:00100000:0.0:1788842119.793546:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+14:14452:x1875736489218560:12345-192.168.204.55@tcp:101:bash.0 Request processed in 2363us (2904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842119.793559:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 29 00000100:00100000:1.0:1788842119.799478:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842119.801265:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489218816 00000100:00100000:2.0:1788842119.801287:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489218816 00000100:00100000:2.0:1788842119.801484:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 5 00000100:00100000:2.0:1788842119.801499:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a761bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+14:14452:x1875736489218816:12345-192.168.204.55@tcp:35:bash.0 00000100:00100000:2.0:1788842119.802032:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a761bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+15:14452:x1875736489218816:12345-192.168.204.55@tcp:35:bash.0 Request processed in 535us (2568us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788842119.802041:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 5 00000100:00100000:1.0:1788842119.810359:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500743296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788842119.810483:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842119.810655:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500743296 00000100:00100000:2.0:1788842119.810682:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500743296 00000100:00100000:2.0:1788842119.810972:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788842119.810984:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a412a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500743296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788842119.811032:0:15046:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788842119.811107:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a412a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500743296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842119.811114:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788842119.811201:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500743296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788842119.893129:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842119.893265:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489219072 00000100:00100000:0.0:1788842119.893278:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489219072 00000100:00100000:0.0:1788842119.893359:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 30 00000100:00100000:0.0:1788842119.893390:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a412ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+15:14462:x1875736489219072:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:0.0:1788842119.893434:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842119.893464:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601800/0x3de1064d33a8c666 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef260d expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788842119.893592:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788842119.894030:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601800/0x3de1064d33a8c666 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef260d expref: 17 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.894050:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3a428dfc00) 00010000:00010000:0.0:1788842119.894054:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788842119.894060:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601800/0x3de1064d33a8c666 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef260d expref: 17 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842119.894078:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a77601800, rc 0) 00000100:00100000:0.0:1788842119.894156:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a412ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+16:14462:x1875736489219072:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 769us (1044us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788842119.894165:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 30 00000100:00100000:1.0:1788842119.898223:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842119.898354:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489219328 00000100:00100000:0.0:1788842119.898370:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489219328 00000100:00100000:0.0:1788842119.898459:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:0.0:1788842119.898473:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a412a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+16:14462:x1875736489219328:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:0.0:1788842119.898869:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a412a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+17:14462:x1875736489219328:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 397us (659us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788842119.898878:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:1.0:1788842119.945882:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842119.946154:0:16232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489219584 00000100:00100000:2.0:1788842119.946169:0:16232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489219584 00000100:00100000:2.0:1788842119.946256:0:16232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 31 00000100:00100000:2.0:1788842119.946270:0:16232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a412aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+17:14465:x1875736489219584:12345-192.168.204.55@tcp:101:lfs.0 00010000:00010000:2.0:1788842119.946304:0:16232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842119.946333:0:16232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8c674 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2614 expref: -99 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.946478:0:16232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c67b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.946496:0:16232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c67b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.946514:0:16232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c67b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788842119.946527:0:16232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788842119.946775:0:16232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8c674 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2614 expref: 20 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.946805:0:16232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c67b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2614 expref: 19 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.946835:0:16232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3a61283600) 00010000:00010000:2.0:1788842119.946848:0:16232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788842119.946853:0:16232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cd400, rc 0) 00000100:00100000:2.0:1788842119.946939:0:16232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a412aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+19:14465:x1875736489219584:12345-192.168.204.55@tcp:101:lfs.0 Request processed in 672us (1072us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788842119.946948:0:16232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 31 00000100:00100000:1.0:1788842119.951185:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842119.951234:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842119.951350:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489219712 00000100:00100000:2.0:1788842119.951363:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489219712 00000100:00100000:2.0:1788842119.951452:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 32 00000100:00100000:2.0:1788842119.951465:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a412a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+19:14465:x1875736489219712:12345-192.168.204.55@tcp:54:lfs.0 00010000:00010000:2.0:1788842119.951575:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8c689 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.951598:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8c689 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.951612:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8c689 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.951648:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8c689 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.951655:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8c689 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.951662:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8c689 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.951667:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cca00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842119.951688:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8c689 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.951697:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8c689 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.951746:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3a61283600) 00010000:00010000:2.0:1788842119.951750:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788842119.951756:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8c689 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842119.951763:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8c689 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842119.951874:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a412a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+19:14465:x1875736489219712:12345-192.168.204.55@tcp:54:lfs.0 Request processed in 413us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842119.951883:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 32 00000100:00100000:3.0:1788842119.952574:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489219840 00000100:00100000:3.0:1788842119.952582:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489219840 00000100:00100000:3.0:1788842119.952634:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:3.0:1788842119.952644:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a412aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+19:2350:x1875736489219840:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788842119.952666:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788842119.952689:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c67b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2614 expref: 19 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842119.952705:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3a61283600) 00010000:00010000:3.0:1788842119.952741:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788842119.952801:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a412aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+18:2350:x1875736489219840:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 158us (1564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842119.952808:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:1.0:1788842119.956330:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842119.956506:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489220096 00000100:00100000:0.0:1788842119.956537:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489220096 00000100:00100000:0.0:1788842119.956612:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:0.0:1788842119.956625:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+18:14465:x1875736489220096:12345-192.168.204.55@tcp:35:lfs.0 00000100:00100000:0.0:1788842119.957350:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+19:14465:x1875736489220096:12345-192.168.204.55@tcp:35:lfs.0 Request processed in 724us (1029us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788842119.957359:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 7 00000040:00080000:2.0:1788842120.003593:0:14389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788842120.282629:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842120.282753:0:16232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489220352 00000100:00100000:2.0:1788842120.282777:0:16232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489220352 00000100:00100000:2.0:1788842120.282857:0:16232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 33 00000100:00100000:2.0:1788842120.282870:0:16232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+19:14496:x1875736489220352:12345-192.168.204.55@tcp:101:cat.0 00010000:00010000:2.0:1788842120.282902:0:16232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842120.282931:0:16232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8c690 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef261b expref: -99 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.283075:0:16232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8c697 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.283093:0:16232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8c697 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.283125:0:16232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8c697 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788842120.283139:0:16232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788842120.283338:0:16232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8c690 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef261b expref: 22 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.283370:0:16232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8c697 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef261b expref: 21 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.283380:0:16232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3a61283600) 00010000:00010000:2.0:1788842120.283383:0:16232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788842120.283388:0:16232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cc000, rc 0) 00000100:00100000:2.0:1788842120.283471:0:16232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+21:14496:x1875736489220352:12345-192.168.204.55@tcp:101:cat.0 Request processed in 602us (856us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788842120.283479:0:16232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 33 00000100:00100000:1.0:1788842120.291805:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842120.291971:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489220608 00000100:00100000:2.0:1788842120.291985:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489220608 00000100:00100000:2.0:1788842120.292063:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:2.0:1788842120.292076:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+21:14496:x1875736489220608:12345-192.168.204.55@tcp:35:cat.0 00000100:00100000:2.0:1788842120.292606:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+22:14496:x1875736489220608:12345-192.168.204.55@tcp:35:cat.0 Request processed in 530us (815us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788842120.292615:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 8 00000100:00100000:3.0:1788842120.293253:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842120.299918:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489220736 00000100:00100000:0.0:1788842120.299939:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489220736 00000100:00100000:0.0:1788842120.300064:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 1 00000100:00100000:0.0:1788842120.300077:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+22:2349:x1875736489220736:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788842120.300098:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788842120.300134:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8c697 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef261b expref: 22 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842120.300164:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3a61283600) 00010000:00010000:0.0:1788842120.300170:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788842120.300262:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+21:2349:x1875736489220736:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 188us (7010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842120.300271:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 1 00000100:00100000:3.0:1788842120.360638:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842120.360802:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489220992 00000100:00100000:2.0:1788842120.360816:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489220992 00000100:00100000:2.0:1788842120.360908:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 34 00000100:00100000:2.0:1788842120.360921:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+21:14502:x1875736489220992:12345-192.168.204.55@tcp:101:dd.0 00010000:00010000:2.0:1788842120.360972:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842120.361001:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8c6a5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2622 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.361151:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8c6ac lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.361169:0:14360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8c64a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25ff expref: 22 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.361179:0:14360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c65f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2606 expref: 22 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.361189:0:14360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8c6ac lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.361230:0:14360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c65f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2606 expref: 22 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.361246:0:14360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c65f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2606 expref: 22 pid: 14359 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842120.361263:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14360:1875736500743424:192.168.204.55@tcp:104: 00010000:00010000:2.0:1788842120.361396:0:14360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8c64a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25ff expref: 22 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.361407:0:14360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8c64a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25ff expref: 22 pid: 14360 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842120.361431:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14360:1875736500743552:192.168.204.55@tcp:104: 00000100:00100000:2.0:1788842120.361459:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a682b9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788842120.364704:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14360:1875736500743424:192.168.204.55@tcp:104: 00000100:00100000:2.0:1788842120.364797:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14360:1875736500743552:192.168.204.55@tcp:104: 00010000:00010000:2.0:1788842120.364850:0:14360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8c6ac lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842120.366630:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842120.366678:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842120.366971:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489221120 00000100:00100000:0.0:1788842120.366983:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489221120 00010000:00010000:0.0:1788842120.367050:0:14344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c65f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2606 expref: 23 pid: 14359 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842120.367090:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489221248 00000100:00100000:0.0:1788842120.367093:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489221248 00010000:00010000:0.0:1788842120.367128:0:14344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8c64a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25ff expref: 24 pid: 14360 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842120.367145:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:0.0:1788842120.367155:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7680f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+24:2350:x1875736489221120:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788842120.367173:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788842120.367180:0:14344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c65f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2606 expref: 24 pid: 14359 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842120.367194:0:14344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c65f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2606 expref: 24 pid: 14359 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842120.367222:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c65f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2606 expref: 24 pid: 14359 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842120.367243:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3a61283600) 00010000:00010000:0.0:1788842120.367249:0:14344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8c6ac lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842120.367257:0:14344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8c6ac lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842120.367265:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788842120.367351:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7680f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+23:2350:x1875736489221120:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 195us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842120.367359:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:0.0:1788842120.367425:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:0.0:1788842120.367432:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+22:2350:x1875736489221248:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788842120.367447:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788842120.367453:0:14344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8c64a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25ff expref: 22 pid: 14360 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842120.367463:0:14344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8c64a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25ff expref: 22 pid: 14360 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842120.367477:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8c64a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef25ff expref: 22 pid: 14360 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842120.367492:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3a61283600) 00010000:00010000:0.0:1788842120.367496:0:14344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8c6ac lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842120.367506:0:14344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8c6ac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842120.367516:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8c6ac lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842120.367543:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788842120.367566:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+21:2350:x1875736489221248:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 134us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842120.367573:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 12 00010000:00010000:2.0:1788842120.367989:0:14360:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8c6ac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.367999:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8c6ac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788842120.368026:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788842120.368257:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8c6a5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2622 expref: 22 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.368279:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd600/0x3de1064d33a8c6ac lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2622 expref: 21 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.368289:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3a61283600) 00010000:00010000:2.0:1788842120.368293:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788842120.368296:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cd600, rc 0) 00000100:00100000:2.0:1788842120.368347:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+21:14502:x1875736489220992:12345-192.168.204.55@tcp:101:dd.0 Request processed in 7430us (7726us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788842120.368356:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 34 00000100:00100000:3.0:1788842120.372869:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842120.373100:0:16232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489221504 00000100:00100000:2.0:1788842120.373114:0:16232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489221504 00000100:00100000:2.0:1788842120.373196:0:16232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 35 00000100:00100000:2.0:1788842120.373208:0:16232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+21:14502:x1875736489221504:12345-192.168.204.55@tcp:36:dd.0 00010000:00010000:2.0:1788842120.373577:0:16232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6ccc00/0x3de1064d33a8c6ba lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.373598:0:16232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6ccc00/0x3de1064d33a8c6ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.373611:0:16232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6ccc00/0x3de1064d33a8c6ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788842120.373672:0:16232:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788842120.373701:0:16232:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000509760e9 reply state 000000009450ea3d transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6ccc00/0x3de1064d33a8c6ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842120.373745:0:16232:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788842120.374225:0:16232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+24:14502:x1875736489221504:12345-192.168.204.55@tcp:36:dd.0 Request processed in 1016us (1367us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788842120.374235:0:16232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 35 00000020:00080000:2.0:1788842120.374241:0:16232:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788842120.377502:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842120.377591:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489221632 00000100:00100000:0.0:1788842120.377605:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489221632 00000100:00100000:0.0:1788842120.377682:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 36 00000100:00100000:0.0:1788842120.377695:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+24:14502:x1875736489221632:12345-192.168.204.55@tcp:101:dd.0 00010000:00010000:0.0:1788842120.377800:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788842120.377991:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600800/0x3de1064d33a8c6c1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2629 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842120.378096:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600800/0x3de1064d33a8c6c1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2629 expref: 25 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842120.378114:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600800/0x3de1064d33a8c6c1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2629 expref: 25 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842120.378138:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3a61283600) 00010000:00010000:0.0:1788842120.378141:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788842120.378146:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a77600800, rc 0) 00000100:00100000:0.0:1788842120.378225:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+25:14502:x1875736489221632:12345-192.168.204.55@tcp:101:dd.0 Request processed in 532us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842120.378232:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 36 00010000:00010000:2.0:1788842120.382482:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6ccc00/0x3de1064d33a8c6ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.382506:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6ccc00/0x3de1064d33a8c6ba lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.382515:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6ccc00/0x3de1064d33a8c6ba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.382523:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6ccc00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842120.382553:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6ccc00/0x3de1064d33a8c6ba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.382563:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6ccc00/0x3de1064d33a8c6ba lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.382590:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3a61283600) 00010000:00010000:2.0:1788842120.382593:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842120.382599:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6ccc00/0x3de1064d33a8c6ba lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.382607:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6ccc00/0x3de1064d33a8c6ba lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842120.390587:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842120.391186:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489221888 00000100:00100000:0.0:1788842120.391200:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489221888 00000100:00100000:0.0:1788842120.391326:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 2 00000100:00100000:0.0:1788842120.391341:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c783480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+24:14502:x1875736489221888:12345-192.168.204.55@tcp:103:dd.0 00010000:00010000:0.0:1788842120.391365:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788842120.391400:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77600800/0x3de1064d33a8c6c1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2629 expref: 24 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842120.391436:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3a61283600) 00010000:00010000:0.0:1788842120.391443:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788842120.391525:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c783480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+23:14502:x1875736489221888:12345-192.168.204.55@tcp:103:dd.0 Request processed in 187us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842120.391552:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 2 00000100:00100000:3.0:1788842120.393472:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842120.393634:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489222016 00000100:00100000:2.0:1788842120.393646:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489222016 00000100:00100000:2.0:1788842120.393737:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 37 00000100:00100000:2.0:1788842120.393750:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+23:14502:x1875736489222016:12345-192.168.204.55@tcp:58:dd.0 00010000:00010000:2.0:1788842120.393949:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6ccc00/0x3de1064d33a8c6c8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.393971:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6ccc00/0x3de1064d33a8c6c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.393986:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6ccc00/0x3de1064d33a8c6c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788842120.395512:0:14359:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788842120.395820:0:14359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788842120.396125:0:14359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788842120.396284:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+23:14502:x1875736489222016:12345-192.168.204.55@tcp:58:dd.0 Request processed in 2530us (2815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842120.396313:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 37 00000100:00100000:3.0:1788842120.398766:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842120.398965:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489222144 00000100:00100000:2.0:1788842120.398979:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489222144 00000100:00100000:2.0:1788842120.399062:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 38 00000100:00100000:2.0:1788842120.399075:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+23:14502:x1875736489222144:12345-192.168.204.55@tcp:101:dd.0 00010000:00010000:2.0:1788842120.399102:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842120.399129:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8c6cf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2630 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.399206:0:14360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6ccc00/0x3de1064d33a8c6c8 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.399219:0:14360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8c6cf lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2630 expref: 24 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.399243:0:14360:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6ccc00/0x3de1064d33a8c6c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.399258:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8c6cf lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2630 expref: 24 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.399274:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3a61283600) 00010000:00010000:2.0:1788842120.399277:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788842120.399281:0:14360:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8c6cf lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2630 expref: 24 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842120.399288:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cca00, rc 0) 00000100:00100000:2.0:1788842120.399378:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+24:14502:x1875736489222144:12345-192.168.204.55@tcp:101:dd.0 Request processed in 305us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842120.399386:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 38 00010000:00010000:3.0:1788842120.711659:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788842121.026161:0:14389:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788842121.026174:0:14389:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788842121.026219:0:14389:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788842121.026227:0:14389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788842121.026629:0:14389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14389:1875736500743680:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788842121.027141:0:14389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a682b9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788842121.035042:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842121.036417:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489222272 00000100:00100000:0.0:1788842121.036438:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489222272 00000100:00100000:0.0:1788842121.036543:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:0.0:1788842121.036559:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:10bbae73-32ed-4506-b337-b06c2cb26bae+25:14503:x1875736489222272:12345-192.168.204.55@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788842121.036684:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:10bbae73-32ed-4506-b337-b06c2cb26bae+25:14503:x1875736489222272:12345-192.168.204.55@tcp:900:lhsmtool_posix.0 Request processed in 131us (1653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842121.036907:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00080000:1.0:1788842121.037154:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788842121.039093:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842121.039253:0:16232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489222400 00000100:00100000:0.0:1788842121.039264:0:16232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489222400 00000100:00100000:0.0:1788842121.039702:0:16232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 39 00000100:00100000:1.0:1788842121.039997:0:16232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+25:14503:x1875736489222400:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788842121.040044:0:16232:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788842121.040183:0:16232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+25:14503:x1875736489222400:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 Request processed in 256us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842121.040193:0:16232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 39 00000100:00100000:2.0:1788842121.040269:0:14389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14389:1875736500743680:192.168.204.55@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788842121.044933:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842121.045065:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489222528 00000100:00100000:2.0:1788842121.045082:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489222528 00000100:00100000:2.0:1788842121.045176:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 40 00000100:00100000:2.0:1788842121.045189:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+24:14503:x1875736489222528:12345-192.168.204.55@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788842121.045297:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8c6d6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045322:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8c6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045340:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8c6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045497:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8c6dd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045516:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8c6dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045541:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8c6dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045571:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8c6e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045580:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8c6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045587:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8c6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788842121.045629:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788842121.045633:0:14360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788842121.045648:0:14360:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8c6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045659:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8c6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045667:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8c6d6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045674:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8c6d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045681:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cda00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842121.045685:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8c6d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045693:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8c6d6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045761:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d3a4e719d00) 00010000:00010000:2.0:1788842121.045765:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842121.045771:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8c6d6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045778:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cda00/0x3de1064d33a8c6d6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045796:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8c6dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045804:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8c6dd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045811:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8c6dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045816:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cc400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842121.045819:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8c6dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045824:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8c6dd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045832:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8d3a61283000) 00010000:00010000:2.0:1788842121.045834:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842121.045837:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8c6dd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045843:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc400/0x3de1064d33a8c6dd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045869:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8c6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045875:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8c6e4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045881:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8c6e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045886:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd000 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842121.045889:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8c6e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045894:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8c6e4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045901:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3a61283600) 00010000:00010000:2.0:1788842121.045903:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842121.045906:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8c6e4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.045911:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8c6e4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842121.046005:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+24:14503:x1875736489222528:12345-192.168.204.55@tcp:34:lhsmtool_posix.0 Request processed in 815us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842121.046015:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 40 00000100:00100000:3.0:1788842121.048691:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842121.049208:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489222784 00000100:00100000:2.0:1788842121.049218:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489222784 00000100:00100000:2.0:1788842121.049321:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 41 00000100:00100000:2.0:1788842121.049344:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+24:14503:x1875736489222784:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788842121.049364:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842121.049383:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8c6eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2637 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.049474:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c6f2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.049488:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c6f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.049499:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c6f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788842121.049509:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788842121.049597:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c6f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.049604:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c6f2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.049612:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c6f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.049617:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842121.049621:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c6f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.049629:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c6f2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.049639:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3a61283600) 00010000:00010000:2.0:1788842121.049647:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788842121.049652:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c6f2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.049658:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd400/0x3de1064d33a8c6f2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.049701:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8c6eb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2637 expref: 26 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.049731:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d3a4e719d00) 00010000:00010000:2.0:1788842121.049733:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788842121.049737:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cc000/0x3de1064d33a8c6eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2637 expref: 26 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.049758:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cc000, rc 0) 00000100:00100000:2.0:1788842121.049912:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+25:14503:x1875736489222784:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 569us (1227us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1788842121.049920:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 41 00000100:00100000:3.0:1788842121.061557:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842121.061823:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489222912 00000100:00100000:0.0:1788842121.061832:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489222912 00000100:00100000:0.0:1788842121.062826:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 42 00000100:00100000:0.0:1788842121.062841:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+25:14503:x1875736489222912:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788842121.062874:0:14357:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788842121.062979:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+25:14503:x1875736489222912:12345-192.168.204.55@tcp:53:lhsmtool_posix.0 Request processed in 142us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842121.062987:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 42 00000100:00100000:0.0:1788842121.068277:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842121.068369:0:16232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489223168 00000100:00100000:1.0:1788842121.068380:0:16232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489223168 00000100:00100000:1.0:1788842121.068442:0:16232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 43 00000100:00100000:1.0:1788842121.068452:0:16232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+25:14503:x1875736489223168:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788842121.068471:0:16232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788842121.068491:0:16232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8c700 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef263e expref: -99 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788842121.069147:0:16232:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:1.0:1788842121.069155:0:16232:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1788842121.069207:0:16232:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1788842121.069448:0:16232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e000/0x3de1064d33a8c707 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.069464:0:16232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e000/0x3de1064d33a8c707 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.069475:0:16232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e000/0x3de1064d33a8c707 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.069529:0:16232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8c700 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef263e expref: 28 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.069546:0:16232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e000/0x3de1064d33a8c707 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef263e expref: 27 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.069556:0:16232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d3a428df300) 00010000:00010000:1.0:1788842121.069559:0:16232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788842121.069562:0:16232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c24e000, rc 0) 00000100:00100000:1.0:1788842121.069787:0:16232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+27:14503:x1875736489223168:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 1336us (1521us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1788842121.069796:0:16232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 43 00000100:00100000:3.0:1788842121.077358:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842121.079036:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489223424 00000100:00100000:2.0:1788842121.079050:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489223424 00000100:00100000:2.0:1788842121.079115:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 44 00000100:00100000:2.0:1788842121.079125:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+27:14503:x1875736489223424:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788842121.079956:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788842121.079990:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e000/0x3de1064d33a8c707 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef263e expref: 27 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.080012:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d3a428df300) 00010000:00010000:2.0:1788842121.080031:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788842121.080369:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c715 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.080385:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c715 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.080408:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c715 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.080425:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031800/0x3de1064d33a8c71c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe835035c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.080433:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031800/0x3de1064d33a8c71c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe835035c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.080440:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031800/0x3de1064d33a8c71c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe835035c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.080519:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c715 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.080892:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c715 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.080900:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c715 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.080907:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40031600 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842121.080912:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c715 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.080921:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c715 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.080933:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d3a61283a00) 00010000:00010000:3.0:1788842121.080936:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788842121.080940:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c715 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.080953:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c715 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.080966:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031800/0x3de1064d33a8c71c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe835035c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.080972:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031800/0x3de1064d33a8c71c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe835035c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.080977:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031800/0x3de1064d33a8c71c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe835035c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.081001:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40031800 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:3.0:1788842121.081004:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031800/0x3de1064d33a8c71c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe835035c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.081011:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031800/0x3de1064d33a8c71c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe835035c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.081020:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xe835035c (ffff8d3a42af4f00) 00010000:00010000:3.0:1788842121.081022:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788842121.081025:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031800/0x3de1064d33a8c71c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe835035c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.081031:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031800/0x3de1064d33a8c71c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe835035c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842121.081132:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+26:14503:x1875736489223424:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 2005us (3780us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788842121.081142:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 44 00000100:00100000:3.0:1788842121.084068:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842121.084206:0:16232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489223552 00000100:00100000:1.0:1788842121.084216:0:16232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489223552 00000100:00100000:1.0:1788842121.084349:0:16232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 45 00000100:00100000:1.0:1788842121.084361:0:16232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c6a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+26:14503:x1875736489223552:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788842121.084399:0:16232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788842121.084424:0:16232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8c723 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2645 expref: -99 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.084462:0:16232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8c72a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.084486:0:16232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8c72a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.084498:0:16232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8c72a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.084587:0:16232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8c723 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2645 expref: 28 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.084605:0:16232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e600/0x3de1064d33a8c72a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2645 expref: 27 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.084615:0:16232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d3a428df200) 00010000:00010000:1.0:1788842121.084617:0:16232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788842121.084622:0:16232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c24e600, rc 0) 00000100:00100000:1.0:1788842121.084682:0:16232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c6a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+27:14503:x1875736489223552:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 323us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842121.084689:0:16232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 45 00000100:00100000:0.0:1788842121.092859:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842121.093971:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489223808 00000100:00100000:1.0:1788842121.093994:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489223808 00000100:00100000:1.0:1788842121.094075:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 46 00000100:00100000:1.0:1788842121.094087:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+27:14503:x1875736489223808:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788842121.094188:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c731 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.094206:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c731 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.094219:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c731 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788842121.094656:0:14357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1788842121.094668:0:14357:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 449251958774ns, next at 450251956537ns, rc = 0 00000004:00010000:1.0:1788842121.094826:0:14357:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de9e523a reply state 00000000f6b37614 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c731 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842121.094836:0:14357:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788842121.094938:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+29:14503:x1875736489223808:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 852us (2088us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1788842121.094946:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 46 00010000:00010000:0.0:1788842121.097412:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c731 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842121.097429:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c731 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842121.097449:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c731 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842121.097456:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24f400 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:0.0:1788842121.097460:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c731 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842121.097469:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c731 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842121.097484:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d3a428df200) 00010000:00010000:0.0:1788842121.097487:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788842121.097491:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c731 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842121.097498:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c731 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842121.100187:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842121.100362:0:16232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489223936 00000100:00100000:1.0:1788842121.100373:0:16232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489223936 00000100:00100000:1.0:1788842121.100446:0:16232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 47 00000100:00100000:1.0:1788842121.100457:0:16232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+28:14503:x1875736489223936:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788842121.100483:0:16232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788842121.100514:0:16232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8c738 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef264c expref: -99 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.100590:0:16232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8c738 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef264c expref: 29 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.100624:0:16232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8c738 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef264c expref: 29 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.100647:0:16232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d3a428df200) 00010000:00010000:1.0:1788842121.100650:0:16232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788842121.100654:0:16232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c24f200, rc 0) 00000100:00100000:1.0:1788842121.100755:0:16232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+29:14503:x1875736489223936:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 289us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842121.100763:0:16232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 47 00000100:00100000:0.0:1788842121.106397:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842121.106484:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489224064 00000100:00100000:2.0:1788842121.106495:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489224064 00000100:00100000:2.0:1788842121.106575:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:2.0:1788842121.106586:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+5:2349:x1875736489224064:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788842121.106732:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788842121.107333:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+6:2349:x1875736489224064:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 Request processed in 747us (943us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788842121.107343:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 12 00000100:00100000:0.0:1788842121.112763:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842121.112907:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489224320 00000100:00100000:2.0:1788842121.112917:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489224320 00000100:00100000:2.0:1788842121.113274:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:2.0:1788842121.113286:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+29:14503:x1875736489224320:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788842121.113816:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+30:14503:x1875736489224320:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 530us (1106us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1788842121.113825:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 9 00000100:00100000:1.0:1788842121.118644:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842121.120670:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489224576 00000100:00100000:3.0:1788842121.120685:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489224576 00000100:00100000:2.0:1788842121.120927:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 48 00000100:00100000:2.0:1788842121.120953:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+30:14503:x1875736489224576:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788842121.121084:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+30:14503:x1875736489224576:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 147us (2450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842121.121092:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 48 00000100:00100000:3.0:1788842121.127424:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842121.127791:0:16232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489224704 00000100:00100000:1.0:1788842121.127803:0:16232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489224704 00000100:00100000:1.0:1788842121.127873:0:16232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 49 00000100:00100000:1.0:1788842121.127884:0:16232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+30:14503:x1875736489224704:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788842121.127905:0:16232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788842121.127928:0:16232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e800/0x3de1064d33a8c73f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2653 expref: -99 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.128016:0:16232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f800/0x3de1064d33a8c746 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.128032:0:16232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f800/0x3de1064d33a8c746 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.128043:0:16232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f800/0x3de1064d33a8c746 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788842121.128305:0:16232:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788842121.128328:0:16232:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f800/0x3de1064d33a8c746 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.128357:0:16232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24e800/0x3de1064d33a8c73f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2653 expref: 32 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.128377:0:16232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f800/0x3de1064d33a8c746 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2653 expref: 31 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.128386:0:16232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d3a428df200) 00010000:00010000:1.0:1788842121.128389:0:16232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788842121.128393:0:16232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c24f800, rc 0) 00000100:00100000:1.0:1788842121.128464:0:16232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+31:14503:x1875736489224704:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 581us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842121.128471:0:16232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 49 00000100:00100000:0.0:1788842121.133467:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842121.133912:0:16010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489224832 00000100:00100000:2.0:1788842121.133923:0:16010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489224832 00000100:00100000:2.0:1788842121.133970:0:16010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:2.0:1788842121.133981:0:16010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+6:2349:x1875736489224832:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788842121.134000:0:16010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788842121.134046:0:16010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8c74d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef265a expref: -99 pid: 16010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788842121.134354:0:16010:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f9088, blocks: 0x1 00010000:00010000:2.0:1788842121.134377:0:16010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788842121.134382:0:16010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788842121.134400:0:16010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8c74d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef265a expref: 7 pid: 16010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.134427:0:16010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8c74d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef265a expref: 7 pid: 16010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.134443:0:16010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a7c6cc000, rc 0) 00000100:00100000:2.0:1788842121.135205:0:16010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+7:2349:x1875736489224832:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 1222us (1745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842121.135215:0:16010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:0.0:1788842121.150073:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842121.150358:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489225088 00000100:00100000:1.0:1788842121.150368:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489225088 00000100:00100000:1.0:1788842121.150428:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 50 00000100:00100000:1.0:1788842121.150439:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+31:14503:x1875736489225088:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788842121.150552:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+31:14503:x1875736489225088:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 114us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842121.150560:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 50 00000100:00100000:3.0:1788842121.155336:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842121.155513:0:16232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489225216 00000100:00100000:1.0:1788842121.155531:0:16232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489225216 00000100:00100000:1.0:1788842121.155593:0:16232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 51 00000100:00100000:1.0:1788842121.155618:0:16232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b77a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+31:14503:x1875736489225216:12345-192.168.204.55@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788842121.269526:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934605 is committed 00000001:00080000:2.0:1788842121.269551:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:2.0:1788842121.269562:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:2.0:1788842121.269567:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788842121.269584:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:2.0:1788842121.269611:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1788842121.269949:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788842121.269970:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500743808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788842121.270051:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842121.270827:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500743808 00000100:00100000:2.0:1788842121.270837:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500743808 00000100:00100000:2.0:1788842121.270920:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788842121.270930:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500743808:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788842121.271399:0:15043:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788842121.271416:0:15043:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788842121.271419:0:15043:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788842121.271420:0:15043:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788842120 -> 1788842120 00002000:00010000:2.0:1788842121.271423:0:15043:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788842121.271627:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1875736500743808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 697us (1574us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788842121.271634:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788842121.275759:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788842121.276887:0:16232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b77a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+14:14503:x1875736489225216:12345-192.168.204.55@tcp:44:lhsmtool_posix.0 Request processed in 121263us (121553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842121.276899:0:16232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 51 00000004:00080000:3.0:1788842121.280788:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d3a75ed2680/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788842121.280805:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500743808:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788842121.281570:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842121.281990:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489225344 00000100:00100000:2.0:1788842121.281998:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489225344 00000100:00100000:2.0:1788842121.282069:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00100000:2.0:1788842121.282088:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+7:2350:x1875736489225344:12345-192.168.204.55@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788842121.282208:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+7:2350:x1875736489225344:12345-192.168.204.55@tcp:16:lhsmtool_posix.0 Request processed in 122us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842121.282215:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00100000:1.0:1788842121.298237:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842121.298400:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489225600 00000100:00100000:0.0:1788842121.298412:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489225600 00000100:00100000:0.0:1788842121.298488:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 52 00000100:00100000:0.0:1788842121.298501:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+14:14503:x1875736489225600:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788842121.298555:0:14357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788842121.298584:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f800/0x3de1064d33a8c746 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2653 expref: 14 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842121.298604:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d3a428df200) 00010000:00010000:0.0:1788842121.298610:0:14357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788842121.298640:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c754 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842121.298653:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c754 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842121.298663:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c754 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788842121.298996:0:14357:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000361945dc reply state 0000000093e2af8f transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c754 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842121.299006:0:14357:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788842121.299439:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+15:14503:x1875736489225600:12345-192.168.204.55@tcp:36:lhsmtool_posix.0 Request processed in 940us (1366us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788842121.299446:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 52 00010000:00010000:2.0:1788842121.304025:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c754 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.304043:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c754 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.304052:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c754 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.304058:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a77601000 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842121.304063:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c754 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.304071:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c754 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.304229:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d3a428df200) 00010000:00010000:2.0:1788842121.304232:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842121.304238:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c754 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.304245:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a77601000/0x3de1064d33a8c754 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842121.305635:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842121.305850:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489225728 00000100:00100000:3.0:1788842121.305860:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489225728 00000100:00100000:3.0:1788842121.305996:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:3.0:1788842121.306007:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+7:14503:x1875736489225728:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788842121.306026:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788842121.306044:0:15044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6e036f9/0x3de1064d33a8c75b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1bc086f6c9ef2661 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.306075:0:15044:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8c74d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef265a expref: 8 pid: 16010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.306085:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788842121.306090:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788842121.306203:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6e036f9/0x3de1064d33a8c75b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2661 expref: 8 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.306242:0:15044:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8c74d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef265a expref: 8 pid: 16010 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.306256:0:15044:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8c74d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef265a expref: 8 pid: 16010 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842121.306282:0:15044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b779500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15044:1875736500743936:192.168.204.55@tcp:104: 00000100:00100000:3.0:1788842121.306390:0:15044:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7607bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788842121.309832:0:15044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b779500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15044:1875736500743936:192.168.204.55@tcp:104: 00010000:00010000:3.0:1788842121.310249:0:15044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d6e036f9/0x3de1064d33a8c75b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2661 expref: 8 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.310277:0:15044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3a40031800, rc 0) 00000100:00100000:0.0:1788842121.310493:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+8:14503:x1875736489225728:12345-192.168.204.55@tcp:101:lhsmtool_posix.0 Request processed in 4485us (4865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842121.310504:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 16 00000100:00100000:2.0:1788842121.317376:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842121.320391:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489225856 00000100:00100000:3.0:1788842121.320410:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489225856 00010000:00010000:3.0:1788842121.320464:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8c74d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef265a expref: 8 pid: 16010 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842121.320536:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 13 00000100:00100000:3.0:1788842121.320548:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+8:2350:x1875736489225856:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788842121.320567:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788842121.320596:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8c74d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef265a expref: 8 pid: 16010 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.320611:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8c74d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef265a expref: 8 pid: 16010 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.320639:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003be445bc/0x3de1064d33a8c74d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef265a expref: 8 pid: 16010 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.320684:0:14345:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788842121.320689:0:14345:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788842121.320696:0:14345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6e036f9/0x3de1064d33a8c75b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2661 expref: 7 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.320737:0:14345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6e036f9/0x3de1064d33a8c75b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2661 expref: 7 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.320793:0:14345:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d6e036f9/0x3de1064d33a8c75b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2661 expref: 7 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842121.320806:0:14345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b779500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14345:1875736500744064:192.168.204.55@tcp:105: 00000100:00100000:3.0:1788842121.321459:0:14345:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7607bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788842121.327834:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842121.327901:0:14345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b779500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14345:1875736500744064:192.168.204.55@tcp:105: 00010000:00010000:3.0:1788842121.327927:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788842121.327932:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489225984 00000100:00100000:2.0:1788842121.327945:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489225984 00000100:00100000:2.0:1788842121.327998:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:2.0:1788842121.328009:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+8:2350:x1875736489225984:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788842121.328034:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+8:2350:x1875736489225856:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 7486us (10673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842121.328045:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 13 00002000:00010000:2.0:1788842121.328218:0:15042:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788842121.328222:0:15042:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788842119 00002000:00010000:2.0:1788842121.328225:0:15042:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788842118 00002000:00010000:2.0:1788842121.328227:0:15042:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788842120 -> 1788842119 00002000:00010000:2.0:1788842121.328239:0:15042:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788842121.328268:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+8:2350:x1875736489225984:12345-192.168.204.55@tcp:2:lhsmtool_posix.0 Request processed in 262us (446us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788842121.328276:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 17 00000100:00100000:0.0:1788842121.357246:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842121.357351:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489226112 00000100:00100000:2.0:1788842121.357362:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489226112 00000100:00100000:2.0:1788842121.357424:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 18 00000100:00100000:2.0:1788842121.357435:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+8:2349:x1875736489226112:12345-192.168.204.55@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788842121.357480:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000744801ef/0x3de1064d33a8c762 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.357514:0:15043:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6e036f9/0x3de1064d33a8c75b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2661 expref: 8 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.357672:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788842121.357677:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788842121.357682:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000744801ef/0x3de1064d33a8c762 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.357766:0:15043:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6e036f9/0x3de1064d33a8c75b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2661 expref: 8 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.357781:0:15043:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6e036f9/0x3de1064d33a8c75b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2661 expref: 8 pid: 15044 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842121.357795:0:15043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15043:1875736500744192:192.168.204.55@tcp:104: 00000100:00100000:2.0:1788842121.357876:0:15043:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e4e9480 going to sleep for 11 seconds 00000100:00100000:2.0:1788842121.365593:0:15043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15043:1875736500744192:192.168.204.55@tcp:104: 00010000:00010000:2.0:1788842121.365626:0:15043:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000744801ef/0x3de1064d33a8c762 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842121.368330:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842121.368461:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489226240 00000100:00100000:1.0:1788842121.368472:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489226240 00010000:00010000:1.0:1788842121.368517:0:14344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6e036f9/0x3de1064d33a8c75b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2661 expref: 9 pid: 15044 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842121.368562:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 14 00000100:00100000:1.0:1788842121.368572:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+9:2349:x1875736489226240:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788842121.368589:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788842121.368614:0:14344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d6e036f9/0x3de1064d33a8c75b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2661 expref: 9 pid: 15044 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.368628:0:14344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6e036f9/0x3de1064d33a8c75b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2661 expref: 9 pid: 15044 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.368651:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6e036f9/0x3de1064d33a8c75b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2661 expref: 9 pid: 15044 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.368668:0:14344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788842121.368680:0:14344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788842121.368686:0:14344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000744801ef/0x3de1064d33a8c762 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.368695:0:14344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000744801ef/0x3de1064d33a8c762 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.368779:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788842121.368833:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+8:2349:x1875736489226240:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 262us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842121.368840:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 14 00010000:00010000:2.0:1788842121.369987:0:15043:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000744801ef/0x3de1064d33a8c762 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.370001:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000744801ef/0x3de1064d33a8c762 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.370041:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000744801ef/0x3de1064d33a8c762 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.370049:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000744801ef/0x3de1064d33a8c762 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.370057:0:15043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000744801ef/0x3de1064d33a8c762 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.370063:0:15043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd400 already unused, calling callback (ffffffffc1813420) 00010000:00010000:2.0:1788842121.370068:0:15043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000744801ef/0x3de1064d33a8c762 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.370099:0:15043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000744801ef/0x3de1064d33a8c762 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.370117:0:15043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000744801ef/0x3de1064d33a8c762 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.370124:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000744801ef/0x3de1064d33a8c762 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842121.370196:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+7:2349:x1875736489226112:12345-192.168.204.55@tcp:1:lhsmtool_posix.0 Request processed in 12760us (12963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842121.370215:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 18 00000100:00100000:0.0:1788842121.391830:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842121.391916:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489226496 00000100:00100000:3.0:1788842121.391927:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489226496 00000100:00100000:3.0:1788842121.392014:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 53 00000100:00100000:3.0:1788842121.392027:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7c5d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+14:14503:x1875736489226496:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788842121.392123:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c769 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.392156:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c769 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.392167:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c769 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.392419:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8c770 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.392432:0:14359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8c738 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef264c expref: 15 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.392446:0:14359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8c770 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.392483:0:14359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8c738 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef264c expref: 15 pid: 16232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.392497:0:14359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8c738 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef264c expref: 15 pid: 16232 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842121.392512:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7b779500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14359:1875736500744320:192.168.204.55@tcp:104: 00000100:00100000:3.0:1788842121.392609:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a7607bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788842121.396083:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842121.396175:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489226624 00000100:00100000:1.0:1788842121.396185:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489226624 00010000:00010000:1.0:1788842121.396224:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8c738 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef264c expref: 16 pid: 16232 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842121.396267:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 15 00000100:00100000:1.0:1788842121.396276:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a412aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+16:2350:x1875736489226624:12345-192.168.204.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788842121.396292:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788842121.396298:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8c738 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef264c expref: 16 pid: 16232 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.396312:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8c738 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef264c expref: 16 pid: 16232 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.396336:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d3a428df200) 00010000:00010000:1.0:1788842121.396341:0:14345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8c770 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.396367:0:14345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8c770 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.396374:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8c770 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.396394:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788842121.396454:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a412aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+16:2350:x1875736489226624:12345-192.168.204.55@tcp:103:ldlm_bl.0 Request processed in 178us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842121.396463:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 15 00010000:00010000:3.0:1788842121.397037:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f200/0x3de1064d33a8c738 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef264c expref: 15 pid: 16232 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842121.397053:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7b779500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14359:1875736500744320:192.168.204.55@tcp:104: 00010000:00010000:3.0:1788842121.397073:0:14359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8c770 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.397090:0:14359:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8c770 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.397095:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8c770 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788842121.397305:0:14359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1788842121.397465:0:14359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1788842121.397514:0:14359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788842121.398842:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14359:1875736500744448:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788842121.398975:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842121.399011:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e4e9540 going to sleep for 11 seconds 00000100:00100000:1.0:1788842121.399229:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500744448 00000100:00100000:1.0:1788842121.399236:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500744448 00000100:00100000:1.0:1788842121.399282:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788842121.399291:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14359:x1875736500744448:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788842121.399378:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14359:x1875736500744448:12345-0@lo:1000:mdt00_001.0 Request processed in 87us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842121.399386:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788842121.399473:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14359:1875736500744448:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788842121.400210:0:14359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788842121.400277:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14359:1875736500744576:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788842121.400328:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842121.400348:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e4e9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788842121.400610:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500744576 00000100:00100000:0.0:1788842121.400616:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500744576 00000100:00100000:0.0:1788842121.400650:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788842121.400659:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14359:x1875736500744576:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788842121.400880:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14359:x1875736500744576:12345-0@lo:1000:mdt00_001.0 Request processed in 221us (551us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788842121.400887:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788842121.401673:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14359:1875736500744576:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788842121.401777:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8c770 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.401789:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8c770 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.401797:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8c770 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.401803:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40031000 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842121.401808:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8c770 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.401817:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8c770 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.401835:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d3a428df200) 00010000:00010000:2.0:1788842121.401838:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788842121.401856:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8c770 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.401862:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031000/0x3de1064d33a8c770 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.401896:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6ccc00/0x3de1064d33a8c6c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.401903:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6ccc00/0x3de1064d33a8c6c8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.401909:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6ccc00/0x3de1064d33a8c6c8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.401915:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6ccc00 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842121.401918:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6ccc00/0x3de1064d33a8c6c8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.401924:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6ccc00/0x3de1064d33a8c6c8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.401932:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3a61283600) 00010000:00010000:2.0:1788842121.401935:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788842121.401942:0:14359:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8c6cf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2630 expref: 18 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.401954:0:14359:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8c6cf lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2630 expref: 18 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.401964:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8c6cf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2630 expref: 18 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.402041:0:14359:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cca00/0x3de1064d33a8c6cf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.55@tcp remote: 0x1bc086f6c9ef2630 expref: 18 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842121.402056:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14359:1875736500744704:192.168.204.55@tcp:105: 00000100:00100000:2.0:1788842121.402152:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3a4e4e9480 going to sleep for 11 seconds 00000100:00100000:0.0:1788842121.409183:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842121.409346:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14359:1875736500744704:192.168.204.55@tcp:105: 00010000:00010000:2.0:1788842121.409383:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6ccc00/0x3de1064d33a8c6c8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.409396:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6ccc00/0x3de1064d33a8c6c8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.409438:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8c777 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.409456:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8c777 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.409467:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8c777 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.409480:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8c777 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.409488:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8c777 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.409495:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8c777 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.409523:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd000 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842121.409528:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8c777 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.409537:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8c777 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.409550:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3a61283600) 00010000:00010000:2.0:1788842121.409553:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788842121.409557:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8c777 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.409563:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c6cd000/0x3de1064d33a8c777 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.409574:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c769 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.409580:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c769 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.409585:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c769 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.409590:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40031600 already unused, calling callback (ffffffffc22304f0) 00010000:00010000:2.0:1788842121.409593:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c769 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.409599:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c769 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.409619:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3a61283600) 00010000:00010000:2.0:1788842121.409621:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788842121.409624:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c769 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.409630:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a40031600/0x3de1064d33a8c769 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842121.409927:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7c5d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bbae73-32ed-4506-b337-b06c2cb26bae+18:14503:x1875736489226496:12345-192.168.204.55@tcp:57:lhsmtool_posix.0 Request processed in 17902us (18107us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788842121.409937:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 53 00000020:00080000:2.0:1788842121.409944:0:14359:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788842121.410217:0:14389:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788842121.410222:0:14389:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788842121.410267:0:14389:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788842121.410272:0:14389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788842121.410440:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489226752 00000100:00100000:1.0:1788842121.410447:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489226752 00000100:00100000:1.0:1788842121.410495:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:1.0:1788842121.410506:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75dc3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+18:14502:x1875736489226752:12345-192.168.204.55@tcp:49:dd.0 00000100:00100000:1.0:1788842121.410614:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75dc3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+18:14502:x1875736489226752:12345-192.168.204.55@tcp:49:dd.0 Request processed in 110us (1444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788842121.410622:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 10 00000100:00100000:0.0:1788842121.421564:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842121.421660:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489227008 00000100:00100000:1.0:1788842121.421670:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489227008 00000100:00100000:1.0:1788842121.421774:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 11 00000100:00100000:1.0:1788842121.421800:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a412a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+18:14503:x1875736489227008:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788842121.422487:0:14361:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788842121.422593:0:14361:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1788842121.422637:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c77e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.422657:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c77e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.422669:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c77e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.422677:0:14361:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c77e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.422683:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c77e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.422690:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c77e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.422702:0:14361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788842121.422862:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a412a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+20:14503:x1875736489227008:12345-192.168.204.55@tcp:35:lhsmtool_posix.0 Request processed in 1061us (1305us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1788842121.422870:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 11 00000020:00080000:1.0:1788842121.422875:0:14361:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788842121.423076:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788842121.423083:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c77e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842121.423099:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24f400 already unused, calling callback (ffffffffc1813420) 00010000:00010000:0.0:1788842121.423104:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c77e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842121.423113:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c77e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842121.423126:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d3a428df200) 00010000:00010000:0.0:1788842121.423128:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788842121.423133:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c77e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842121.423140:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3a7c24f400/0x3de1064d33a8c77e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842121.423153:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842121.423163:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788842121.423165:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788842121.642830:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842121.642870:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:3.0:1788842121.642907:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842121.643109:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489227264 00000100:00100000:2.0:1788842121.643119:0:15049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489227264 00000100:00100000:2.0:1788842121.643168:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489227136 00000100:00100000:2.0:1788842121.643171:0:15049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489227136 00000100:00100000:2.0:1788842121.643186:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489227392 00000100:00100000:2.0:1788842121.643188:0:15049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489227392 00000100:00100000:2.0:1788842121.643210:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:2.0:1788842121.643230:0:15049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+9:2352:x1875736489227264:12345-192.168.204.55@tcp:4:dd.0 00002000:00010000:2.0:1788842121.643282:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9f9087, atime: 0x6a9f9086, ctime: 0x6a9f9087, blocks: 0x1 00010000:00010000:2.0:1788842121.643291:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000006ff78f/0x3de1064d33a8c785 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.643308:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788842121.643313:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788842121.643320:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000006ff78f/0x3de1064d33a8c785 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.643352:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000006ff78f/0x3de1064d33a8c785 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842121.646187:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842121.646331:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:1.0:1788842121.646355:0:15048:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788842121.648410:0:15048:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788842121.649560:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489227520 00000100:00100000:3.0:1788842121.649574:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489227520 00000100:00100000:1.0:1788842121.650843:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:0.0:1788842121.656611:0:15047:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788842121.658454:0:15048:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788842121.659610:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842121.659960:0:16586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489227648 00000100:00100000:2.0:1788842121.659974:0:16586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489227648 00000100:00100000:2.0:1788842121.660198:0:16586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489227776 00000100:00100000:2.0:1788842121.660203:0:16586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489227776 00000100:00100000:2.0:1788842121.660223:0:16586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 1 00000100:00100000:2.0:1788842121.660232:0:16586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+13:2352:x1875736489227136:12345-192.168.204.55@tcp:4:dd.0 00010000:00010000:2.0:1788842121.660325:0:16586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f910993/0x3de1064d33a8c78c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.660346:0:16586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788842121.660351:0:16586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788842121.660357:0:16586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f910993/0x3de1064d33a8c78c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.660371:0:16586:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f910993/0x3de1064d33a8c78c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788842121.660581:0:15047:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1788842121.661601:0:16587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 2 00000100:00100000:0.0:1788842121.661616:0:16587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b77b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:10bbae73-32ed-4506-b337-b06c2cb26bae+13:2351:x1875736489227392:12345-192.168.204.55@tcp:4:dd.0 00010000:00010000:0.0:1788842121.661649:0:16587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1034ee3/0x3de1064d33a8c793 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842121.661666:0:16587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842121.661670:0:16587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788842121.661676:0:16587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1034ee3/0x3de1064d33a8c793 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788842121.661689:0:16587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1034ee3/0x3de1064d33a8c793 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842121.665203:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842121.665540:0:15048:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1788842121.665551:0:15048:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:2.0:1788842121.665653:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489227904 00000100:00100000:2.0:1788842121.665663:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489227904 00000100:00100000:2.0:1788842121.665754:0:15048:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1788842121.665768:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489228032 00000100:00100000:2.0:1788842121.665771:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489228032 00000100:00100000:2.0:1788842121.676577:0:16588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 3 00000100:00100000:2.0:1788842121.676604:0:16588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:10bbae73-32ed-4506-b337-b06c2cb26bae+17:2351:x1875736489227520:12345-192.168.204.55@tcp:4:dd.0 00010000:00010000:2.0:1788842121.678148:0:16588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff7c29ad/0x3de1064d33a8c79a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.678174:0:16588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788842121.678179:0:16588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788842121.678187:0:16588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff7c29ad/0x3de1064d33a8c79a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.678207:0:16588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff7c29ad/0x3de1064d33a8c79a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.730788:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788842121.802131:0:15049:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1788842121.802140:0:15049:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788842119 -> 1788842120 00002000:00010000:1.0:1788842121.802143:0:15049:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788842119 -> 1788842120 00002000:00010000:1.0:1788842121.802145:0:15049:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 6151 00010000:00010000:1.0:1788842121.802163:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000006ff78f/0x3de1064d33a8c785 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.802178:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000006ff78f/0x3de1064d33a8c785 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.802188:0:15049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000006ff78f/0x3de1064d33a8c785 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.802194:0:15049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cd000 already unused, calling callback (ffffffffc1813420) 00010000:00010000:1.0:1788842121.802199:0:15049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000006ff78f/0x3de1064d33a8c785 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.802207:0:15049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000006ff78f/0x3de1064d33a8c785 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.802229:0:15049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000006ff78f/0x3de1064d33a8c785 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.802237:0:15049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000006ff78f/0x3de1064d33a8c785 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788842121.802333:0:15049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+25:2352:x1875736489227264:12345-192.168.204.55@tcp:4:dd.0 Request processed in 159109us (159512us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788842121.802357:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 0 00000100:00100000:1.0:1788842121.802543:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 4 00000100:00100000:1.0:1788842121.802558:0:15049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+24:2351:x1875736489227648:12345-192.168.204.55@tcp:4:dd.0 00010000:00010000:1.0:1788842121.802666:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c7a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.802679:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842121.802684:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788842121.802689:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c7a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788842121.802701:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c7a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788842121.802935:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1788842121.802950:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:1.0:1788842121.802965:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00010000:00010000:2.0:1788842121.803553:0:16586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f910993/0x3de1064d33a8c78c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.803565:0:16586:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f910993/0x3de1064d33a8c78c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.803572:0:16586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f910993/0x3de1064d33a8c78c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.803578:0:16586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6ccc00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:2.0:1788842121.803593:0:16586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f910993/0x3de1064d33a8c78c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.803616:0:16586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f910993/0x3de1064d33a8c78c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.803633:0:16586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f910993/0x3de1064d33a8c78c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.803640:0:16586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f910993/0x3de1064d33a8c78c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842121.803694:0:16586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+16:2352:x1875736489227136:12345-192.168.204.55@tcp:4:dd.0 Request processed in 143461us (160821us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788842121.803701:0:16586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 1 00000100:00100000:2.0:1788842121.803757:0:16586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 5 00000100:00100000:2.0:1788842121.803767:0:16586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+15:2351:x1875736489227776:12345-192.168.204.55@tcp:4:dd.0 00010000:00010000:2.0:1788842121.803788:0:16586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bfcdfd7/0x3de1064d33a8c7a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.803799:0:16586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788842121.803802:0:16586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788842121.803806:0:16586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bfcdfd7/0x3de1064d33a8c7a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.803816:0:16586:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bfcdfd7/0x3de1064d33a8c7a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.804106:0:16587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1034ee3/0x3de1064d33a8c793 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.804116:0:16587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1034ee3/0x3de1064d33a8c793 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.804124:0:16587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1034ee3/0x3de1064d33a8c793 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.804131:0:16587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a77600e00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:3.0:1788842121.804142:0:16587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1034ee3/0x3de1064d33a8c793 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.804149:0:16587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1034ee3/0x3de1064d33a8c793 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.804162:0:16587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1034ee3/0x3de1064d33a8c793 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.804170:0:16587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1034ee3/0x3de1064d33a8c793 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842121.804213:0:16587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b77b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:10bbae73-32ed-4506-b337-b06c2cb26bae+14:2351:x1875736489227392:12345-192.168.204.55@tcp:4:dd.0 Request processed in 142601us (161305us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788842121.804220:0:16587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 2 00000100:00100000:3.0:1788842121.804236:0:16587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 6 00000100:00100000:3.0:1788842121.804244:0:16587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:10bbae73-32ed-4506-b337-b06c2cb26bae+13:2351:x1875736489227904:12345-192.168.204.55@tcp:4:dd.0 00010000:00010000:3.0:1788842121.804261:0:16587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e5cb22b/0x3de1064d33a8c7af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.804269:0:16587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788842121.804272:0:16587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788842121.804276:0:16587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e5cb22b/0x3de1064d33a8c7af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.804287:0:16587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e5cb22b/0x3de1064d33a8c7af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788842121.891973:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:2.0:1788842121.892564:0:16588:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 7340032 00002000:00010000:2.0:1788842121.892570:0:16588:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:2.0:1788842121.892585:0:16588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff7c29ad/0x3de1064d33a8c79a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.892598:0:16588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff7c29ad/0x3de1064d33a8c79a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.892607:0:16588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff7c29ad/0x3de1064d33a8c79a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.892613:0:16588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cda00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:2.0:1788842121.892618:0:16588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff7c29ad/0x3de1064d33a8c79a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.892626:0:16588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff7c29ad/0x3de1064d33a8c79a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.892649:0:16588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff7c29ad/0x3de1064d33a8c79a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.892657:0:16588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff7c29ad/0x3de1064d33a8c79a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842121.892917:0:16588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:10bbae73-32ed-4506-b337-b06c2cb26bae+18:2351:x1875736489227520:12345-192.168.204.55@tcp:4:dd.0 Request processed in 216319us (246848us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788842121.892945:0:16588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 3 00000100:00100000:2.0:1788842121.892980:0:16588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:2.0:1788842121.892993:0:16588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:10bbae73-32ed-4506-b337-b06c2cb26bae+17:2352:x1875736489228032:12345-192.168.204.55@tcp:4:dd.0 00010000:00010000:2.0:1788842121.893037:0:16588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f910993/0x3de1064d33a8c7b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.893052:0:16588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788842121.893056:0:16588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788842121.893062:0:16588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f910993/0x3de1064d33a8c7b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.893073:0:16588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f910993/0x3de1064d33a8c7b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788842121.945771:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:2.0:1788842121.946185:0:16586:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:2.0:1788842121.946191:0:16586:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 14343 00010000:00010000:2.0:1788842121.946207:0:16586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bfcdfd7/0x3de1064d33a8c7a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.946220:0:16586:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bfcdfd7/0x3de1064d33a8c7a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.946229:0:16586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bfcdfd7/0x3de1064d33a8c7a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.946237:0:16586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6cc400 already unused, calling callback (ffffffffc1813420) 00010000:00010000:2.0:1788842121.946256:0:16586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bfcdfd7/0x3de1064d33a8c7a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.946267:0:16586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bfcdfd7/0x3de1064d33a8c7a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.946290:0:16586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bfcdfd7/0x3de1064d33a8c7a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.946299:0:16586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bfcdfd7/0x3de1064d33a8c7a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842121.946470:0:16586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:10bbae73-32ed-4506-b337-b06c2cb26bae+13:2351:x1875736489227776:12345-192.168.204.55@tcp:4:dd.0 Request processed in 142700us (295632us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788842121.946480:0:16586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 5 00010000:00010000:3.0:1788842121.949769:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c7a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.949790:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c7a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.949799:0:15049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c7a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.949806:0:15049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c24e000 already unused, calling callback (ffffffffc1813420) 00010000:00010000:3.0:1788842121.949811:0:15049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c7a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.949820:0:15049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c7a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.949841:0:15049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c7a1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.949849:0:15049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3127f8e/0x3de1064d33a8c7a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842121.949936:0:15049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+11:2351:x1875736489227648:12345-192.168.204.55@tcp:4:dd.0 Request processed in 147378us (303600us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1788842121.949947:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 4 00010000:00010000:3.0:1788842121.950041:0:16587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e5cb22b/0x3de1064d33a8c7af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.950049:0:16587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e5cb22b/0x3de1064d33a8c7af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.950057:0:16587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e5cb22b/0x3de1064d33a8c7af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.950062:0:16587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a40030c00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:3.0:1788842121.950065:0:16587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e5cb22b/0x3de1064d33a8c7af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.950073:0:16587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e5cb22b/0x3de1064d33a8c7af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.950083:0:16587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e5cb22b/0x3de1064d33a8c7af lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788842121.950090:0:16587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e5cb22b/0x3de1064d33a8c7af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788842121.950123:0:16587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:10bbae73-32ed-4506-b337-b06c2cb26bae+9:2351:x1875736489227904:12345-192.168.204.55@tcp:4:dd.0 Request processed in 145879us (290522us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788842121.950129:0:16587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 6 00000001:00080000:0.0:1788842121.992473:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:2.0:1788842121.992799:0:16588:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1788842121.992817:0:16588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f910993/0x3de1064d33a8c7b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.992831:0:16588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f910993/0x3de1064d33a8c7b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.992841:0:16588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f910993/0x3de1064d33a8c7b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.992848:0:16588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3a7c6ccc00 already unused, calling callback (ffffffffc1813420) 00010000:00010000:2.0:1788842121.992853:0:16588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f910993/0x3de1064d33a8c7b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.992873:0:16588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f910993/0x3de1064d33a8c7b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.992891:0:16588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f910993/0x3de1064d33a8c7b6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788842121.992899:0:16588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f910993/0x3de1064d33a8c7b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788842121.993082:0:16588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:10bbae73-32ed-4506-b337-b06c2cb26bae+5:2352:x1875736489228032:12345-192.168.204.55@tcp:4:dd.0 Request processed in 100089us (327882us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788842121.993093:0:16588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 7 00000100:00100000:2.0:1788842122.662683:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842122.662773:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842122.662808:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842122.662833:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842122.662854:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842122.662872:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842122.662893:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.55@tcp (source: 12345-192.168.204.55@tcp) 00000100:00100000:2.0:1788842122.662922:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489228416 00000100:00100000:2.0:1788842122.662933:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489228416 00000100:00100000:2.0:1788842122.662985:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489228928 00000100:00100000:2.0:1788842122.662989:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489228928 00000100:00100000:2.0:1788842122.663005:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489228544 00000100:00100000:2.0:1788842122.663008:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489228544 00000100:00100000:2.0:1788842122.663019:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489228800 00000100:00100000:2.0:1788842122.663021:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489228800 00000100:00100000:2.0:1788842122.663057:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 18 00000100:00100000:2.0:1788842122.663067:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+5:2350:x1875736489228416:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788842122.663136:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+5:2350:x1875736489228416:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 70us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842122.663144:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 18 00000100:00100000:2.0:1788842122.663163:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 19 00000100:00100000:2.0:1788842122.663170:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36a793d4-b9b8-4df6-a0a0-b45d7f854203+5:2350:x1875736489228928:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788842122.663193:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36a793d4-b9b8-4df6-a0a0-b45d7f854203+5:2350:x1875736489228928:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 24us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842122.663199:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 19 00000100:00100000:2.0:1788842122.663211:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 20 00000100:00100000:2.0:1788842122.663218:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+5:2349:x1875736489228544:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788842122.663241:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10bbae73-32ed-4506-b337-b06c2cb26bae+5:2349:x1875736489228544:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 24us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842122.663248:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 20 00000100:00100000:2.0:1788842122.663258:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00100000:2.0:1788842122.663264:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36a793d4-b9b8-4df6-a0a0-b45d7f854203+5:2349:x1875736489228800:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788842122.663286:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36a793d4-b9b8-4df6-a0a0-b45d7f854203+5:2349:x1875736489228800:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 22us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842122.663291:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 21 00000100:00100000:2.0:1788842122.663309:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489228288 00000100:00100000:2.0:1788842122.663313:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489228288 00000100:00100000:2.0:1788842122.663336:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489228672 00000100:00100000:2.0:1788842122.663339:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489228672 00000100:00100000:2.0:1788842122.663367:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 27 00000100:00100000:2.0:1788842122.663374:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+20:2349:x1875736489228288:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788842122.663406:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bbae73-32ed-4506-b337-b06c2cb26bae+20:2349:x1875736489228288:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 33us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842122.663413:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 27 00000100:00100000:2.0:1788842122.663426:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 28 00000100:00100000:2.0:1788842122.663433:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a793d4-b9b8-4df6-a0a0-b45d7f854203+6:2350:x1875736489228672:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:2.0:1788842122.663456:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36a793d4-b9b8-4df6-a0a0-b45d7f854203+6:2350:x1875736489228672:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 24us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842122.663462:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 28 00000100:00080000:2.0:1788842122.663481:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788842122.663486:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788842122.663488:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788842122.663763:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736489228160 00000100:00100000:3.0:1788842122.663768:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736489228160 00000100:00100000:3.0:1788842122.663815:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.55@tcp, seq: 122 00000100:00100000:3.0:1788842122.663823:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7d87cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+13:2350:x1875736489228160:12345-192.168.204.55@tcp:400:kworker.0 00000100:00100000:3.0:1788842122.663864:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7d87cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4fd51e06-eb1a-40f6-8c4f-348236053b9d+13:2350:x1875736489228160:12345-192.168.204.55@tcp:400:kworker.0 Request processed in 42us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842122.663870:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.55@tcp, seq: 122 00010000:00010000:0.0:1788842122.755698:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788842123.740417:0:16627:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1788842123.785285:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788842124.418089:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500744960:0@lo:400:kworker.0 00000100:00100000:1.0:1788842124.418265:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875736500745216:0@lo:400:kworker.0 00000100:00100000:1.0:1788842124.418362:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842124.418433:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6792fa91-218c-4171-b8ed-40bcd3d71b04:3307:1875736500744832:0@lo:400:kworker.0 00000100:00100000:0.0:1788842124.418494:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a76807b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500745088:0@lo:400:kworker.0 00000100:00100000:3.0:1788842124.420179:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842124.420287:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500745472:0@lo:400:kworker.0 00000100:00100000:2.0:1788842124.420321:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842124.420444:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842124.420498:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500745216 00000100:00100000:3.0:1788842124.420508:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500745216 00000100:00100000:3.0:1788842124.420664:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500745472 00000100:00100000:3.0:1788842124.420668:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500745472 00000100:00100000:3.0:1788842124.420749:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788842124.420761:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875736500745216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788842124.420830:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875736500745216:12345-0@lo:400:kworker.0 Request processed in 70us (2469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842124.420838:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788842124.420857:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788842124.420864:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b77ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500745472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788842124.420898:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b77ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875736500745472:12345-0@lo:400:kworker.0 Request processed in 35us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842124.420904:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788842124.420927:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788842124.420965:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875736500745472:0@lo:400:kworker.0 00000100:00100000:3.0:1788842124.421275:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500744960 00000100:00100000:3.0:1788842124.421297:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500744960 00000100:00100000:3.0:1788842124.421334:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788842124.421342:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7b77b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500744960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788842124.421396:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7b77b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875736500744960:12345-0@lo:400:kworker.0 Request processed in 56us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842124.421404:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788842124.421419:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788842124.421440:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875736500744960:0@lo:400:kworker.0 00000100:00100000:3.0:1788842124.421475:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500744832 00000100:00100000:3.0:1788842124.421479:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500744832 00000100:00100000:0.0:1788842124.421506:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788842124.421554:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500745600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788842124.421588:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842124.421627:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788842124.421634:0:16010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500745088 00000100:00100000:0.0:1788842124.421639:0:16010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500745088 00000100:00100000:3.0:1788842124.421641:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7d87c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:3307:x1875736500744832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788842124.421696:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7d87c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6792fa91-218c-4171-b8ed-40bcd3d71b04+19:3307:x1875736500744832:12345-0@lo:400:kworker.0 Request processed in 60us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788842124.421703:0:16010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788842124.421707:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788842124.421746:0:16010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500745088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788842124.421801:0:16010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500745088:12345-0@lo:400:kworker.0 Request processed in 61us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842124.421805:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500745600 00000100:00100000:0.0:1788842124.421810:0:16010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788842124.421811:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500745600 00000100:00100000:3.0:1788842124.421848:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788842124.421854:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000100:00100000:3.0:1788842124.421859:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a7616c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500745600:12345-0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1788842124.421863:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d3a75ed2680, transno 8589934595 00000004:00080000:0.0:1788842124.421880:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00002000:00000024:3.0:1788842124.421902:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788842124.421904:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76807b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500745088:0@lo:400:kworker.0 00000100:00100000:3.0:1788842124.421954:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a7616c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875736500745600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842124.421961:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788842124.421977:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788842124.422408:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875736500745216:0@lo:400:kworker.0 00000100:00100000:1.0:1788842124.422464:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875736500745600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788842124.422567:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a76805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6792fa91-218c-4171-b8ed-40bcd3d71b04:3307:1875736500744832:0@lo:400:kworker.0 00000100:00100000:2.0:1788842124.422576:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a7616c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500745344:0@lo:400:kworker.0 00000100:00100000:2.0:1788842124.422617:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788842124.423950:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500745344 00000100:00100000:3.0:1788842124.423966:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500745344 00000100:00100000:3.0:1788842124.424121:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788842124.424149:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500745344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788842124.424263:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875736500745344:12345-0@lo:400:kworker.0 Request processed in 118us (1645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788842124.424271:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788842124.424345:0:14353:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788842124.424377:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a7616c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875736500745344:0@lo:400:kworker.0 00010000:00010000:3.0:1788842124.803726:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788842124.932769:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500745728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788842124.932867:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788842124.933927:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875736500745728 00000100:00100000:2.0:1788842124.933945:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875736500745728 00000100:00100000:2.0:1788842124.934037:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788842124.934051:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3a75cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500745728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788842124.934105:0:15045:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788842124.934237:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3a75cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875736500745728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 189us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788842124.934248:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788842124.934335:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3a75ed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875736500745728:0@lo:13:osp-pre-0-0.0 Debug log: 29781 lines, 29781 kept, 0 dropped, 0 bad.